2024.10.22 00:01:34.873306 [ 530 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2024.10.22 00:01:34.884648 [ 530 ] {} Context: Server was built with sanitizer. It will work slowly. 2024.10.22 00:01:34.891280 [ 530 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.10.22 00:01:36.746119 [ 530 ] {} Context: The setting 'merge_tree_metadata_cache' is enabled. But the feature of 'metadata cache in RocksDB' is experimental and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. See the corresponding report at https://github.com/ClickHouse/ClickHouse/issues/51182 2024.10.22 00:01:39.375375 [ 530 ] {} KeeperLogStore: No logs exists in /var/lib/clickhouse/coordination/logs. It's Ok if it's the first run of clickhouse-keeper. 2024.10.22 00:01:39.378224 [ 530 ] {} KeeperLogStore: Removing all changelogs 2024.10.22 00:01:39.385440 [ 530 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.10.22 00:01:39.391013 [ 530 ] {} KeeperStateManager: No state was read 2024.10.22 00:01:39.392100 [ 530 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.10.22 00:01:39.392459 [ 530 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.10.22 00:01:39.548439 [ 780 ] {} RaftInstance: Election timeout, initiate leader election 2024.10.22 00:01:39.741739 [ 530 ] {} Access(local_directory): File /var/lib/clickhouse/access/users.list doesn't exist 2024.10.22 00:01:39.742183 [ 530 ] {} Access(local_directory): Recovering lists in directory /var/lib/clickhouse/access/ 2024.10.22 00:01:40.261249 [ 530 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.10.22 00:02:35.626766 [ 914 ] {} ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, unsigned long&, String&&) @ 0x000000000c5edab7 in /usr/bin/clickhouse 3. DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x000000000c5ed651 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/TransformEndianness.hpp:18: Coordination::ZooKeeper::receiveEvent() @ 0x0000000036452b89 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::receiveThread() @ 0x00000000364518b7 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036463582 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f6fa14a1ac3 in ? 10. ? @ 0x00007f6fa1533850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:02:35.663771 [ 913 ] {} ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:48572 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: Coordination::ZooKeeperRequest::write(DB::WriteBuffer&) const @ 0x00000000363fab6b in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::sendThread() @ 0x000000003644ef7d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036463022 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f6fa14a1ac3 in ? 10. ? @ 0x00007f6fa1533850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:02:35.695311 [ 914 ] {} ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x000000003dc7fe2e in /usr/bin/clickhouse 3. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9c71c in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::shutdown() @ 0x000000003dca241d in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:969: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000003643c54f in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Coordination::ZooKeeper::receiveThread() @ 0x0000000036452540 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036463582 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f6fa14a1ac3 in ? 11. ? @ 0x00007f6fa1533850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:03:23.853695 [ 770 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2024.10.22 00:03:23.869333 [ 768 ] {} KeeperLogStore: Raft server is not set in LogStore. 2024.10.22 00:03:23.903944 [ 530 ] {} KeeperLogStore: Changelog is shut down 2024.10.22 00:03:44.969744 [ 1021 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2024.10.22 00:03:44.972170 [ 1021 ] {} Context: Server was built with sanitizer. It will work slowly. 2024.10.22 00:03:44.981124 [ 1021 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.10.22 00:03:48.894750 [ 1021 ] {} Context: The setting 'merge_tree_metadata_cache' is enabled. But the feature of 'metadata cache in RocksDB' is experimental and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. See the corresponding report at https://github.com/ClickHouse/ClickHouse/issues/51182 2024.10.22 00:03:52.219711 [ 1021 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.10.22 00:03:52.227458 [ 1021 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.10.22 00:03:52.227841 [ 1021 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.10.22 00:03:52.295766 [ 1284 ] {} RaftInstance: Election timeout, initiate leader election 2024.10.22 00:03:55.148904 [ 1021 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.10.22 00:04:48.930548 [ 1364 ] {} ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, unsigned long&, String&&) @ 0x000000000c5edab7 in /usr/bin/clickhouse 3. DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x000000000c5ed651 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/TransformEndianness.hpp:18: Coordination::ZooKeeper::receiveEvent() @ 0x0000000036452b89 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::receiveThread() @ 0x00000000364518b7 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036463582 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f7000ebfac3 in ? 10. ? @ 0x00007f7000f51850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:04:49.045889 [ 1414 ] {} ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:55360 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: Coordination::ZooKeeperRequest::write(DB::WriteBuffer&) const @ 0x00000000363fab6b in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::sendThread() @ 0x000000003644ef7d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036463022 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f7000ebfac3 in ? 10. ? @ 0x00007f7000f51850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:04:49.067751 [ 1364 ] {} ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x000000003dc7fe2e in /usr/bin/clickhouse 3. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9c71c in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::shutdown() @ 0x000000003dca241d in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:969: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000003643c54f in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Coordination::ZooKeeper::receiveThread() @ 0x0000000036452540 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036463582 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f7000ebfac3 in ? 11. ? @ 0x00007f7000f51850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:11:36.275347 [ 1314 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7d3fec91-0520-4e37-8845-b18bfd5f5a52::202410_1_66_13}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x000000001d610bdd in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x000000001d60c57c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::finish() @ 0x000000003499483e in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992afd in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f7000ebfac3 in ? 13. ? @ 0x00007f7000f51850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:22:00.647944 [ 1306 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/ojo/mzgmydtbuhdvnpktewojomuygzjuk, total size 62294646, count 62294646, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id dbbf7be6-e46d-45a9-910f-97d696b8bdfe, upload has finished false. 2024.10.22 00:22:00.648013 [ 1306 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/ojo/mzgmydtbuhdvnpktewojomuygzjuk, total size 62294646, count 62294646, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id dbbf7be6-e46d-45a9-910f-97d696b8bdfe, upload has finished false 2024.10.22 00:22:00.655702 [ 1307 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/lzt/sirhjujcwoilluinxfwviovlgxxho, total size 46381564, count 46381564, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 1af1e023-4bd8-4f23-a151-a8a0fedfaf53, upload has finished false. 2024.10.22 00:22:00.655759 [ 1307 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/lzt/sirhjujcwoilluinxfwviovlgxxho, total size 46381564, count 46381564, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 1af1e023-4bd8-4f23-a151-a8a0fedfaf53, upload has finished false 2024.10.22 00:22:00.669423 [ 1306 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/ojo/mzgmydtbuhdvnpktewojomuygzjuk, total size 62294646, count 62294646, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id dbbf7be6-e46d-45a9-910f-97d696b8bdfe, upload has finished false 2024.10.22 00:22:00.677543 [ 1307 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/lzt/sirhjujcwoilluinxfwviovlgxxho, total size 46381564, count 46381564, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 1af1e023-4bd8-4f23-a151-a8a0fedfaf53, upload has finished false 2024.10.22 00:22:00.689989 [ 1306 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/ziw/ybpdxeaiznbyjewawrsevvmgnfcdx, total size 61276264, count 61276264, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 128558e5-81b0-463d-b8a4-4398710b0af3, upload has finished false. 2024.10.22 00:22:00.690046 [ 1306 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/ziw/ybpdxeaiznbyjewawrsevvmgnfcdx, total size 61276264, count 61276264, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 128558e5-81b0-463d-b8a4-4398710b0af3, upload has finished false 2024.10.22 00:22:00.691847 [ 1307 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/aga/pstjrpxwutlpetmvdbyihuzjnulrw, total size 52653122, count 52653122, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id e695e17c-96af-4f36-a115-eae80dea0ecc, upload has finished false. 2024.10.22 00:22:00.691901 [ 1307 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/aga/pstjrpxwutlpetmvdbyihuzjnulrw, total size 52653122, count 52653122, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id e695e17c-96af-4f36-a115-eae80dea0ecc, upload has finished false 2024.10.22 00:22:00.712066 [ 1306 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/ziw/ybpdxeaiznbyjewawrsevvmgnfcdx, total size 61276264, count 61276264, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 128558e5-81b0-463d-b8a4-4398710b0af3, upload has finished false 2024.10.22 00:22:00.713559 [ 1306 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/usq/jdsmaoodjxkswaujhxwfxuzjfvrlo, total size 88285704, count 88285704, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id da0856d5-7e70-46d1-9690-adb20cfcc59e, upload has finished false. 2024.10.22 00:22:00.713620 [ 1306 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/usq/jdsmaoodjxkswaujhxwfxuzjfvrlo, total size 88285704, count 88285704, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id da0856d5-7e70-46d1-9690-adb20cfcc59e, upload has finished false 2024.10.22 00:22:00.719311 [ 1307 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/aga/pstjrpxwutlpetmvdbyihuzjnulrw, total size 52653122, count 52653122, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id e695e17c-96af-4f36-a115-eae80dea0ecc, upload has finished false 2024.10.22 00:22:00.720513 [ 1307 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/phg/qzzrhykxccllekbztdyyswxzyiimb, total size 74896084, count 74896084, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 876a76b0-5122-4a10-9095-412bf1de7ad7, upload has finished false. 2024.10.22 00:22:00.720557 [ 1307 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/phg/qzzrhykxccllekbztdyyswxzyiimb, total size 74896084, count 74896084, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 876a76b0-5122-4a10-9095-412bf1de7ad7, upload has finished false 2024.10.22 00:22:00.743393 [ 1306 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/usq/jdsmaoodjxkswaujhxwfxuzjfvrlo, total size 88285704, count 88285704, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id da0856d5-7e70-46d1-9690-adb20cfcc59e, upload has finished false 2024.10.22 00:22:00.748484 [ 1307 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/phg/qzzrhykxccllekbztdyyswxzyiimb, total size 74896084, count 74896084, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 876a76b0-5122-4a10-9095-412bf1de7ad7, upload has finished false 2024.10.22 00:22:02.183912 [ 1021 ] {} KeeperLogStore: Changelog is shut down 2024.10.22 00:22:24.160958 [ 1908 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2024.10.22 00:22:24.162139 [ 1908 ] {} Context: Server was built with sanitizer. It will work slowly. 2024.10.22 00:22:24.163829 [ 1908 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2024.10.22 00:22:24.170215 [ 1908 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.10.22 00:22:27.148388 [ 1908 ] {} Context: The setting 'merge_tree_metadata_cache' is enabled. But the feature of 'metadata cache in RocksDB' is experimental and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. See the corresponding report at https://github.com/ClickHouse/ClickHouse/issues/51182 2024.10.22 00:22:30.391576 [ 1908 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.10.22 00:22:30.398716 [ 1908 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.10.22 00:22:30.399162 [ 1908 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.10.22 00:22:30.454488 [ 2163 ] {} RaftInstance: Election timeout, initiate leader election 2024.10.22 00:22:34.660197 [ 1908 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.10.22 00:23:36.200531 [ 2430 ] {} ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, unsigned long&, String&&) @ 0x000000000c5edab7 in /usr/bin/clickhouse 3. DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x000000000c5ed651 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/TransformEndianness.hpp:18: Coordination::ZooKeeper::receiveEvent() @ 0x0000000036452b89 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::receiveThread() @ 0x00000000364518b7 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036463582 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:23:36.231019 [ 2429 ] {} ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:45706 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: Coordination::ZooKeeperRequest::write(DB::WriteBuffer&) const @ 0x00000000363fab6b in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::sendThread() @ 0x000000003644ef7d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036463022 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:23:36.259837 [ 2430 ] {} ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x000000003dc7fe2e in /usr/bin/clickhouse 3. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9c71c in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::shutdown() @ 0x000000003dca241d in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:969: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000003643c54f in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Coordination::ZooKeeper::receiveThread() @ 0x0000000036452540 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036463582 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:23:43.807425 [ 2570 ] {e02cbec9-02c1-4b5b-a591-7473208e3aa8} executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50088) (comment: 03174_merge_join_bug.sql) (in query: SET allow_experimental_analyzer=1, join_algorithm = 'full_sorting_merge';), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:43.825923 [ 2570 ] {e02cbec9-02c1-4b5b-a591-7473208e3aa8} TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:45.220857 [ 1912 ] {} TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:32: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x000000002e2d4fef in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges&, DB::SettingSource) const @ 0x000000002f94f2c3 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:1704: DB::TCPHandler::receiveQuery() @ 0x0000000034f06780 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x0000000034eec063 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed58db in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:47.407982 [ 2479 ] {c319dbe8-f04a-4a8f-a114-d11e15a0fc7d} executeQuery: Code: 403. DB::Exception: Not allowed function in JOIN ON. Unexpected 'arrayJoin([1])': While processing arrayJoin([1]) = b. (INVALID_JOIN_ON_EXPRESSION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50192) (comment: 01429_join_on_error_messages.sql) (in query: SELECT 1 FROM (select 1 a) A JOIN (select 1 b) B ON (arrayJoin([1]) = B.b);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:160: DB::CollectJoinOnKeysMatcher::getIdentifiers(std::shared_ptr const&, std::vector>&) @ 0x0000000031fb6739 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::CollectJoinOnKeysMatcher::getTableForIdentifiers(std::shared_ptr const&, bool, DB::CollectJoinOnKeysMatcher::Data const&) @ 0x0000000031fb3b97 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:0: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb4f8c in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc572 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:47.413396 [ 2479 ] {c319dbe8-f04a-4a8f-a114-d11e15a0fc7d} TCPHandler: Code: 403. DB::Exception: Not allowed function in JOIN ON. Unexpected 'arrayJoin([1])': While processing arrayJoin([1]) = b. (INVALID_JOIN_ON_EXPRESSION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:160: DB::CollectJoinOnKeysMatcher::getIdentifiers(std::shared_ptr const&, std::vector>&) @ 0x0000000031fb6739 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::CollectJoinOnKeysMatcher::getTableForIdentifiers(std::shared_ptr const&, bool, DB::CollectJoinOnKeysMatcher::Data const&) @ 0x0000000031fb3b97 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:0: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb4f8c in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc572 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:47.719929 [ 2479 ] {97635842-0f73-4e33-a180-9049d0e4198c} executeQuery: Code: 403. DB::Exception: Not allowed function in JOIN ON. Unexpected 'arrayJoin([1])': While processing a = arrayJoin([1]). (INVALID_JOIN_ON_EXPRESSION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50192) (comment: 01429_join_on_error_messages.sql) (in query: SELECT 1 FROM (select 1 a) A JOIN (select 1 b) B ON (A.a = arrayJoin([1]));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:160: DB::CollectJoinOnKeysMatcher::getIdentifiers(std::shared_ptr const&, std::vector>&) @ 0x0000000031fb6739 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::CollectJoinOnKeysMatcher::getTableForIdentifiers(std::shared_ptr const&, bool, DB::CollectJoinOnKeysMatcher::Data const&) @ 0x0000000031fb3b97 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:0: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb4f9f in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc572 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:47.756173 [ 2479 ] {97635842-0f73-4e33-a180-9049d0e4198c} TCPHandler: Code: 403. DB::Exception: Not allowed function in JOIN ON. Unexpected 'arrayJoin([1])': While processing a = arrayJoin([1]). (INVALID_JOIN_ON_EXPRESSION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:160: DB::CollectJoinOnKeysMatcher::getIdentifiers(std::shared_ptr const&, std::vector>&) @ 0x0000000031fb6739 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::CollectJoinOnKeysMatcher::getTableForIdentifiers(std::shared_ptr const&, bool, DB::CollectJoinOnKeysMatcher::Data const&) @ 0x0000000031fb3b97 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:0: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb4f9f in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc572 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:48.228495 [ 2479 ] {a78b929e-bf4b-4641-959c-16b5bce5a404} executeQuery: Code: 62. DB::Exception: Function equals takes two arguments, got 'equals(a)' instead: While processing equals(a). (SYNTAX_ERROR) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50192) (comment: 01429_join_on_error_messages.sql) (in query: SELECT 1 FROM (select 1 a) A JOIN (select 1 b) B ON equals(a);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000e33d536 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:102: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb5bcd in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc572 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:48.230368 [ 2479 ] {a78b929e-bf4b-4641-959c-16b5bce5a404} TCPHandler: Code: 62. DB::Exception: Function equals takes two arguments, got 'equals(a)' instead: While processing equals(a). (SYNTAX_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000e33d536 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:102: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb5bcd in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc572 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:48.394723 [ 2479 ] {36aefcd5-7e75-4226-ac95-d331b41ca197} executeQuery: Code: 62. DB::Exception: Function less takes two arguments, got 'less(a)' instead: While processing less(a). (SYNTAX_ERROR) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50192) (comment: 01429_join_on_error_messages.sql) (in query: SELECT 1 FROM (select 1 a) A JOIN (select 1 b) B ON less(a);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000e33d536 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:102: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb5bcd in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc572 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:48.400753 [ 2479 ] {36aefcd5-7e75-4226-ac95-d331b41ca197} TCPHandler: Code: 62. DB::Exception: Function less takes two arguments, got 'less(a)' instead: While processing less(a). (SYNTAX_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000e33d536 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:102: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb5bcd in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc572 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:48.446318 [ 2653 ] {473c18fe-0b9c-428a-9c48-adc798cc8d63} executeQuery: Code: 47. DB::Exception: Missing columns: 'URL' while processing query: 'SELECT uniq(URL) FROM test.hits WHERE TraficSourceID IN (7)', required columns: 'TraficSourceID' 'URL', maybe you meant: 'TraficSourceID'. (UNKNOWN_IDENTIFIER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50260) (comment: 00060_move_to_prewhere_and_sets.sql) (in query: SELECT uniq(URL) FROM test.hits WHERE TraficSourceID IN (7);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000bdd57ee in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr const&, bool, bool) @ 0x0000000031ed2df8 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edcb59 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:48.467342 [ 2653 ] {473c18fe-0b9c-428a-9c48-adc798cc8d63} TCPHandler: Code: 47. DB::Exception: Missing columns: 'URL' while processing query: 'SELECT uniq(URL) FROM test.hits WHERE TraficSourceID IN (7)', required columns: 'TraficSourceID' 'URL', maybe you meant: 'TraficSourceID'. (UNKNOWN_IDENTIFIER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000bdd57ee in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr const&, bool, bool) @ 0x0000000031ed2df8 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edcb59 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:48.755501 [ 1912 ] {42ee0f05-5ae5-47d1-8bc4-4832d863df4a} executeQuery: Code: 42. DB::Exception: Number of arguments for function formatDateTime doesn't match: passed 0, should be 2 or 3: While processing formatDateTime(). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50270) (comment: 00718_format_datetime.sql) (in query: SELECT formatDateTime();), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, unsigned long&&) @ 0x000000000bdfa9be in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::getReturnTypeImpl(std::vector> const&) const @ 0x000000001194f298 in /usr/bin/clickhouse 4. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:23:48.850315 [ 1912 ] {42ee0f05-5ae5-47d1-8bc4-4832d863df4a} TCPHandler: Code: 42. DB::Exception: Number of arguments for function formatDateTime doesn't match: passed 0, should be 2 or 3: While processing formatDateTime(). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, unsigned long&&) @ 0x000000000bdfa9be in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::getReturnTypeImpl(std::vector> const&) const @ 0x000000001194f298 in /usr/bin/clickhouse 4. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:23:48.857959 [ 2479 ] {06e2286b-cb48-430c-b003-31a7f95a52c5} executeQuery: Code: 403. DB::Exception: Unsupported JOIN ON conditions. Unexpected 'a > b': While processing a > b. (INVALID_JOIN_ON_EXPRESSION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50192) (comment: 01429_join_on_error_messages.sql) (in query: SELECT 1 FROM (select 1 a) A JOIN (select 1 b) B ON a = b AND a > b;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:151: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb594e in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069b0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069bb in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc581 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:48.872779 [ 2507 ] {5cb47771-42a8-4fde-94e8-9d60f9d7d7e9} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:23:48.873892 [ 2479 ] {06e2286b-cb48-430c-b003-31a7f95a52c5} TCPHandler: Code: 403. DB::Exception: Unsupported JOIN ON conditions. Unexpected 'a > b': While processing a > b. (INVALID_JOIN_ON_EXPRESSION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:151: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb594e in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069b0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069bb in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc581 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:49.507726 [ 1912 ] {b13983bc-779b-4dfb-98ce-b9ec69f13b3a} executeQuery: Code: 43. DB::Exception: Illegal type String of first argument of function formatDateTime. Should be a date or a date with time: While processing formatDateTime('not a datetime', 'IGNORED'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50270) (comment: 00718_format_datetime.sql) (in query: SELECT formatDateTime('not a datetime', 'IGNORED');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::getReturnTypeImpl(std::vector> const&) const @ 0x000000001194f95b in /usr/bin/clickhouse 4. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:23:49.630189 [ 1912 ] {b13983bc-779b-4dfb-98ce-b9ec69f13b3a} TCPHandler: Code: 43. DB::Exception: Illegal type String of first argument of function formatDateTime. Should be a date or a date with time: While processing formatDateTime('not a datetime', 'IGNORED'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::getReturnTypeImpl(std::vector> const&) const @ 0x000000001194f95b in /usr/bin/clickhouse 4. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:23:49.630418 [ 2479 ] {8de47768-f3b3-4fd8-8a80-e42864af01a2} executeQuery: Code: 403. DB::Exception: Unsupported JOIN ON conditions. Unexpected 'a < b': While processing a < b. (INVALID_JOIN_ON_EXPRESSION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50192) (comment: 01429_join_on_error_messages.sql) (in query: SELECT 1 FROM (select 1 a) A JOIN (select 1 b) B ON a = b AND a < b;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:151: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb594e in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069b0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069bb in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc581 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:49.630901 [ 2611 ] {12404acc-01d7-49c1-ade2-6eecf340c0b1} executeQuery: Code: 80. DB::Exception: Cannot CREATE a table AS test_ji5j9php.mv_from_base_to_target, it is a Materialized View without storage. Use "AS `test_ji5j9php.target_table`" instead. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50160) (comment: 03161_create_table_as_mv.sql) (in query: CREATE TABLE other_table_2 AS mv_from_base_to_target;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, DB::QualifiedTableName&&) @ 0x0000000030f7d1db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:982: DB::InterpreterCreateQuery::setEngine(DB::ASTCreateQuery&) const @ 0x0000000030f47887 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:673: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x0000000030f3e073 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f50859 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:49.632003 [ 2479 ] {8de47768-f3b3-4fd8-8a80-e42864af01a2} TCPHandler: Code: 403. DB::Exception: Unsupported JOIN ON conditions. Unexpected 'a < b': While processing a < b. (INVALID_JOIN_ON_EXPRESSION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:151: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb594e in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069b0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069bb in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc581 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:49.634122 [ 2611 ] {12404acc-01d7-49c1-ade2-6eecf340c0b1} TCPHandler: Code: 80. DB::Exception: Cannot CREATE a table AS test_ji5j9php.mv_from_base_to_target, it is a Materialized View without storage. Use "AS `test_ji5j9php.target_table`" instead. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, DB::QualifiedTableName&&) @ 0x0000000030f7d1db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:982: DB::InterpreterCreateQuery::setEngine(DB::ASTCreateQuery&) const @ 0x0000000030f47887 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:673: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x0000000030f3e073 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f50859 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:49.745536 [ 1912 ] {fad676fb-14e6-417a-a439-b99fc1e40316} executeQuery: Code: 43. DB::Exception: Illegal type DateTime of second argument of function formatDateTime. Must be String.: While processing formatDateTime(now(), now()). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50270) (comment: 00718_format_datetime.sql) (in query: SELECT formatDateTime(now(), now());), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::getReturnTypeImpl(std::vector> const&) const @ 0x000000001194f637 in /usr/bin/clickhouse 4. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:23:49.763016 [ 1912 ] {fad676fb-14e6-417a-a439-b99fc1e40316} TCPHandler: Code: 43. DB::Exception: Illegal type DateTime of second argument of function formatDateTime. Must be String.: While processing formatDateTime(now(), now()). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::getReturnTypeImpl(std::vector> const&) const @ 0x000000001194f637 in /usr/bin/clickhouse 4. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:23:50.220955 [ 1912 ] {d0d49d3c-a6b2-4684-a0a7-e63534039bcc} executeQuery: Code: 43. DB::Exception: Illegal type DateTime of third argument of function formatDateTime. Must be String.: While processing formatDateTime(now(), 'good format pattern', now()). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50270) (comment: 00718_format_datetime.sql) (in query: SELECT formatDateTime(now(), 'good format pattern', now());), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::getReturnTypeImpl(std::vector> const&) const @ 0x000000001194f725 in /usr/bin/clickhouse 4. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:23:50.220951 [ 2479 ] {c0a42dc6-e5b5-40e7-a4fb-cc9716af2a0e} executeQuery: Code: 403. DB::Exception: Unsupported JOIN ON conditions. Unexpected 'a >= b': While processing a >= b. (INVALID_JOIN_ON_EXPRESSION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50192) (comment: 01429_join_on_error_messages.sql) (in query: SELECT 1 FROM (select 1 a) A JOIN (select 1 b) B ON a = b AND a >= b;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:151: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb594e in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069b0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069bb in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc581 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:50.335646 [ 2479 ] {c0a42dc6-e5b5-40e7-a4fb-cc9716af2a0e} TCPHandler: Code: 403. DB::Exception: Unsupported JOIN ON conditions. Unexpected 'a >= b': While processing a >= b. (INVALID_JOIN_ON_EXPRESSION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:151: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb594e in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069b0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069bb in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc581 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:50.335617 [ 1912 ] {d0d49d3c-a6b2-4684-a0a7-e63534039bcc} TCPHandler: Code: 43. DB::Exception: Illegal type DateTime of third argument of function formatDateTime. Must be String.: While processing formatDateTime(now(), 'good format pattern', now()). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::getReturnTypeImpl(std::vector> const&) const @ 0x000000001194f725 in /usr/bin/clickhouse 4. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:23:50.690845 [ 2479 ] {f138ea60-ef32-499d-a27c-0e1f0ca6d32d} executeQuery: Code: 403. DB::Exception: Unsupported JOIN ON conditions. Unexpected 'a <= b': While processing a <= b. (INVALID_JOIN_ON_EXPRESSION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50192) (comment: 01429_join_on_error_messages.sql) (in query: SELECT 1 FROM (select 1 a) A JOIN (select 1 b) B ON a = b AND a <= b;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:151: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb594e in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069b0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069bb in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc581 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:50.691309 [ 1912 ] {20cd45b9-45d9-44c7-8fed-08f054cfdf91} executeQuery: Code: 36. DB::Exception: '%' must not be the last character in the format string, use '%%' instead: While processing formatDateTime(now(), 'unescaped %'). (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50270) (comment: 00718_format_datetime.sql) (in query: SELECT formatDateTime(now(), 'unescaped %');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [74]) @ 0x0000000011a68da9 in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::throwLastCharacterIsPercentException() @ 0x0000000011962ede in /usr/bin/clickhouse 4. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001194d7da in /usr/bin/clickhouse 5. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 11. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:23:50.694686 [ 2479 ] {f138ea60-ef32-499d-a27c-0e1f0ca6d32d} TCPHandler: Code: 403. DB::Exception: Unsupported JOIN ON conditions. Unexpected 'a <= b': While processing a <= b. (INVALID_JOIN_ON_EXPRESSION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:151: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb594e in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069b0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069bb in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc581 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:50.697889 [ 1912 ] {20cd45b9-45d9-44c7-8fed-08f054cfdf91} TCPHandler: Code: 36. DB::Exception: '%' must not be the last character in the format string, use '%%' instead: While processing formatDateTime(now(), 'unescaped %'). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [74]) @ 0x0000000011a68da9 in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::throwLastCharacterIsPercentException() @ 0x0000000011962ede in /usr/bin/clickhouse 4. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001194d7da in /usr/bin/clickhouse 5. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 11. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:23:50.970771 [ 1912 ] {33a5f53a-7aff-488f-92b6-ab8331b43c67} executeQuery: Code: 48. DB::Exception: format is not supported for WEEK (Sun-Sat): While processing formatDateTime(toDateTime('2018-01-02 22:33:44'), '%U'). (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50270) (comment: 00718_format_datetime.sql) (in query: SELECT formatDateTime(toDateTime('2018-01-02 22:33:44'), '%U');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [43]) @ 0x000000000bda8e69 in /usr/bin/clickhouse 3. unsigned long DB::(anonymous namespace)::FunctionFormatDateTimeImpl::parseFormat(String const&, std::vector::Instruction, std::allocator::Instruction>>&, unsigned int, bool, String&) const @ 0x000000001196fbbd in /usr/bin/clickhouse 4. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001194be85 in /usr/bin/clickhouse 5. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 11. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:23:51.106962 [ 2479 ] {958f6c72-91d2-4ca1-95e8-be99b4f4c6ad} executeQuery: Code: 48. DB::Exception: Only `hash` join supports multiple ORs for keys in JOIN ON section. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50192) (comment: 01429_join_on_error_messages.sql) (in query: SELECT 1 FROM (select 1 a) A JOIN (select 1 b, 1 c) B ON a = b OR a = c;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [67]) @ 0x000000001a9072a9 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf719 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:51.107350 [ 1912 ] {33a5f53a-7aff-488f-92b6-ab8331b43c67} TCPHandler: Code: 48. DB::Exception: format is not supported for WEEK (Sun-Sat): While processing formatDateTime(toDateTime('2018-01-02 22:33:44'), '%U'). (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [43]) @ 0x000000000bda8e69 in /usr/bin/clickhouse 3. unsigned long DB::(anonymous namespace)::FunctionFormatDateTimeImpl::parseFormat(String const&, std::vector::Instruction, std::allocator::Instruction>>&, unsigned int, bool, String&) const @ 0x000000001196fbbd in /usr/bin/clickhouse 4. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001194be85 in /usr/bin/clickhouse 5. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 11. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:23:51.117782 [ 2479 ] {958f6c72-91d2-4ca1-95e8-be99b4f4c6ad} TCPHandler: Code: 48. DB::Exception: Only `hash` join supports multiple ORs for keys in JOIN ON section. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [67]) @ 0x000000001a9072a9 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf719 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:51.370228 [ 2479 ] {505c7208-66c8-40f8-8aa7-40e9b0736b54} executeQuery: Code: 48. DB::Exception: Only `hash` join supports multiple ORs for keys in JOIN ON section. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50192) (comment: 01429_join_on_error_messages.sql) (in query: SELECT 1 FROM (select 1 a) A JOIN (select 1 b, 1 c) B ON a = b OR a = c;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [67]) @ 0x000000001a9072a9 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf719 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:51.370646 [ 1912 ] {2950d346-4fb2-463c-b39e-001d5d4cb51d} executeQuery: Code: 48. DB::Exception: format is not supported for WEEK (Mon-Sun): While processing formatDateTime(toDateTime('2018-01-02 22:33:44'), '%v'). (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50270) (comment: 00718_format_datetime.sql) (in query: SELECT formatDateTime(toDateTime('2018-01-02 22:33:44'), '%v');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [43]) @ 0x000000000bda8e69 in /usr/bin/clickhouse 3. unsigned long DB::(anonymous namespace)::FunctionFormatDateTimeImpl::parseFormat(String const&, std::vector::Instruction, std::allocator::Instruction>>&, unsigned int, bool, String&) const @ 0x000000001196f999 in /usr/bin/clickhouse 4. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001194be85 in /usr/bin/clickhouse 5. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 11. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:23:51.380021 [ 2479 ] {505c7208-66c8-40f8-8aa7-40e9b0736b54} TCPHandler: Code: 48. DB::Exception: Only `hash` join supports multiple ORs for keys in JOIN ON section. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [67]) @ 0x000000001a9072a9 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf719 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:51.597372 [ 1912 ] {2950d346-4fb2-463c-b39e-001d5d4cb51d} TCPHandler: Code: 48. DB::Exception: format is not supported for WEEK (Mon-Sun): While processing formatDateTime(toDateTime('2018-01-02 22:33:44'), '%v'). (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [43]) @ 0x000000000bda8e69 in /usr/bin/clickhouse 3. unsigned long DB::(anonymous namespace)::FunctionFormatDateTimeImpl::parseFormat(String const&, std::vector::Instruction, std::allocator::Instruction>>&, unsigned int, bool, String&) const @ 0x000000001196f999 in /usr/bin/clickhouse 4. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001194be85 in /usr/bin/clickhouse 5. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 11. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:23:51.630232 [ 2479 ] {47d57d82-493f-4449-b5b9-aba9ecc4bd42} executeQuery: Code: 403. DB::Exception: Unsupported JOIN ON conditions. Unexpected '(b > 0) OR (t2.b > 0)': While processing (b > 0) OR (t2.b > 0). (INVALID_JOIN_ON_EXPRESSION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50192) (comment: 01429_join_on_error_messages.sql) (in query: -- conditions for different table joined via OR SELECT * FROM (SELECT 1 AS a, 1 AS b, 1 AS c) AS t1 INNER JOIN (SELECT 1 AS a, 1 AS b, 1 AS c) AS t2 ON t1.a = t2.a AND (t1.b > 0 OR t2.b > 0);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:151: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb594e in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069b0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069bb in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc581 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:51.642568 [ 2479 ] {47d57d82-493f-4449-b5b9-aba9ecc4bd42} TCPHandler: Code: 403. DB::Exception: Unsupported JOIN ON conditions. Unexpected '(b > 0) OR (t2.b > 0)': While processing (b > 0) OR (t2.b > 0). (INVALID_JOIN_ON_EXPRESSION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.cpp:151: DB::CollectJoinOnKeysMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::CollectJoinOnKeysMatcher::Data&) @ 0x0000000031fb594e in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/CollectJoinOnKeysVisitor.h:67: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x0000000031f0631e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069b0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: void DB::InDepthNodeVisitor const>::visitChildren(std::shared_ptr const&) @ 0x0000000031f069bb in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edc581 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:51.893478 [ 1912 ] {56677bfb-a2cd-4757-8014-a07aa601dbd4} executeQuery: Code: 48. DB::Exception: format is not supported for YEAR for week (Mon-Sun): While processing formatDateTime(toDateTime('2018-01-02 22:33:44'), '%x'). (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50270) (comment: 00718_format_datetime.sql) (in query: SELECT formatDateTime(toDateTime('2018-01-02 22:33:44'), '%x');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [52]) @ 0x000000000d9f10c9 in /usr/bin/clickhouse 3. unsigned long DB::(anonymous namespace)::FunctionFormatDateTimeImpl::parseFormat(String const&, std::vector::Instruction, std::allocator::Instruction>>&, unsigned int, bool, String&) const @ 0x000000001196f9d9 in /usr/bin/clickhouse 4. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001194be85 in /usr/bin/clickhouse 5. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 11. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:23:51.909096 [ 1912 ] {56677bfb-a2cd-4757-8014-a07aa601dbd4} TCPHandler: Code: 48. DB::Exception: format is not supported for YEAR for week (Mon-Sun): While processing formatDateTime(toDateTime('2018-01-02 22:33:44'), '%x'). (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [52]) @ 0x000000000d9f10c9 in /usr/bin/clickhouse 3. unsigned long DB::(anonymous namespace)::FunctionFormatDateTimeImpl::parseFormat(String const&, std::vector::Instruction, std::allocator::Instruction>>&, unsigned int, bool, String&) const @ 0x000000001196f9d9 in /usr/bin/clickhouse 4. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001194be85 in /usr/bin/clickhouse 5. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 11. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:23:52.372763 [ 1912 ] {61dc281c-4bdf-4f28-9765-0298fdbb9d8b} executeQuery: Code: 48. DB::Exception: format is not supported for YEAR for week (Sun-Sat): While processing formatDateTime(toDateTime('2018-01-02 22:33:44'), '%X'). (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50270) (comment: 00718_format_datetime.sql) (in query: SELECT formatDateTime(toDateTime('2018-01-02 22:33:44'), '%X');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [52]) @ 0x000000000d9f10c9 in /usr/bin/clickhouse 3. unsigned long DB::(anonymous namespace)::FunctionFormatDateTimeImpl::parseFormat(String const&, std::vector::Instruction, std::allocator::Instruction>>&, unsigned int, bool, String&) const @ 0x000000001196fb7e in /usr/bin/clickhouse 4. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001194be85 in /usr/bin/clickhouse 5. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 11. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:23:52.376731 [ 1912 ] {61dc281c-4bdf-4f28-9765-0298fdbb9d8b} TCPHandler: Code: 48. DB::Exception: format is not supported for YEAR for week (Sun-Sat): While processing formatDateTime(toDateTime('2018-01-02 22:33:44'), '%X'). (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [52]) @ 0x000000000d9f10c9 in /usr/bin/clickhouse 3. unsigned long DB::(anonymous namespace)::FunctionFormatDateTimeImpl::parseFormat(String const&, std::vector::Instruction, std::allocator::Instruction>>&, unsigned int, bool, String&) const @ 0x000000001196fb7e in /usr/bin/clickhouse 4. DB::(anonymous namespace)::FunctionFormatDateTimeImpl::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001194be85 in /usr/bin/clickhouse 5. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 11. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:23:53.900501 [ 2675 ] {aaf60cf3-cfd2-4e94-ad2c-312334145fab} executeQuery: Code: 520. DB::Exception: Cannot drop/detach dictionary dict_db_01225.dict as table, use DROP DICTIONARY or DETACH DICTIONARY query instead. (CANNOT_DETACH_DICTIONARY_AS_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:58984) (comment: 01225_drop_dictionary_as_table.sql) (in query: DROP TABLE dict_db_01225.dict;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDictionary.cpp:151: DB::StorageDictionary::checkTableCanBeDropped(std::shared_ptr) const @ 0x0000000032db841d in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116d548 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:92: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000003116a56b in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168302 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:53.914993 [ 2675 ] {aaf60cf3-cfd2-4e94-ad2c-312334145fab} TCPHandler: Code: 520. DB::Exception: Cannot drop/detach dictionary dict_db_01225.dict as table, use DROP DICTIONARY or DETACH DICTIONARY query instead. (CANNOT_DETACH_DICTIONARY_AS_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDictionary.cpp:151: DB::StorageDictionary::checkTableCanBeDropped(std::shared_ptr) const @ 0x0000000032db841d in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:0: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116d548 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:92: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000003116a56b in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168302 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:57.067743 [ 2526 ] {d3ce4a79-323c-42f4-af1a-6cf33be9d2bb} executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59108) (comment: 03142_untuple_crash.sql) (in query: SET allow_experimental_analyzer=1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:23:57.068891 [ 2526 ] {d3ce4a79-323c-42f4-af1a-6cf33be9d2bb} TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:01.567101 [ 2570 ] {6549460c-324a-44b2-8856-0ab1b2652b7a} executeQuery: Code: 60. DB::Exception: Table test.hits does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50138) (comment: 00148_monotonic_functions_and_index.sql) (in query: SELECT count() FROM test.hits WHERE toInt16(CounterID) = 1731;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:01.745051 [ 2570 ] {6549460c-324a-44b2-8856-0ab1b2652b7a} TCPHandler: Code: 60. DB::Exception: Table test.hits does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:04.515269 [ 2479 ] {625c8936-9040-4a4a-97dd-c79e1faf8856} executeQuery: Code: 47. DB::Exception: Missing columns: 'SendTiming' while processing query: 'SELECT CounterID, quantileTiming(0.5)(SendTiming) AS qt, least(30000, quantileExact(0.5)(SendTiming)) AS qe, count() AS c, round(abs(qt - qe) / greatest(qt, qe) AS diff, 3) AS rounded_diff FROM test.hits WHERE SendTiming != -1 GROUP BY CounterID HAVING diff != 0 ORDER BY diff DESC SETTINGS optimize_aggregation_in_order = 1', required columns: 'CounterID' 'SendTiming', maybe you meant: 'CounterID'. (UNKNOWN_IDENTIFIER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:58982) (comment: 00150_quantiles_timing_precision.sql) (in query: SELECT CounterID, quantileTiming(0.5)(SendTiming) AS qt, least(30000, quantileExact(0.5)(SendTiming)) AS qe, count() AS c, round(abs(qt - qe) / greatest(qt, qe) AS diff, 3) AS rounded_diff FROM test.hits WHERE SendTiming != -1 GROUP BY CounterID HAVING diff != 0 ORDER BY diff DESC SETTINGS optimize_aggregation_in_order = 1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000bdd57ee in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr const&, bool, bool) @ 0x0000000031ed2df8 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edcb59 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:04.533268 [ 2479 ] {625c8936-9040-4a4a-97dd-c79e1faf8856} TCPHandler: Code: 47. DB::Exception: Missing columns: 'SendTiming' while processing query: 'SELECT CounterID, quantileTiming(0.5)(SendTiming) AS qt, least(30000, quantileExact(0.5)(SendTiming)) AS qe, count() AS c, round(abs(qt - qe) / greatest(qt, qe) AS diff, 3) AS rounded_diff FROM test.hits WHERE SendTiming != -1 GROUP BY CounterID HAVING diff != 0 ORDER BY diff DESC SETTINGS optimize_aggregation_in_order = 1', required columns: 'CounterID' 'SendTiming', maybe you meant: 'CounterID'. (UNKNOWN_IDENTIFIER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000bdd57ee in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr const&, bool, bool) @ 0x0000000031ed2df8 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edcb59 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:08.800977 [ 3877 ] {9e173f75-e2d2-4db3-85da-bf05e501f41b} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:50854). (NETWORK_ERROR) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50854) (comment: 02015_async_inserts_stress_long.sh) (in query: SELECT * FROM system.asynchronous_inserts FORMAT Null), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProfileInfo(DB::ProfileInfo const&) @ 0x0000000034ef8d6e in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:967: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x0000000034eef305 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:503: DB::TCPHandler::runImpl() @ 0x0000000034ed6fc7 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:08.813032 [ 3829 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:46: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f86 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:08.813868 [ 3735 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:46: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f86 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:08.814550 [ 3744 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:46: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f86 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:08.815918 [ 3732 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:46: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f86 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:08.817525 [ 3747 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:46: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f86 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:08.848508 [ 3731 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:46: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f86 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:08.848574 [ 3877 ] {9e173f75-e2d2-4db3-85da-bf05e501f41b} TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:50854). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x0000000034f12fcc in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__hash_table:1473: DB::TCPHandler::sendLogs() @ 0x0000000034ef1d88 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed8b98 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:08.852785 [ 2570 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:46: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f86 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:08.853561 [ 3746 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:46: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f86 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:08.853616 [ 3877 ] {9e173f75-e2d2-4db3-85da-bf05e501f41b} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:50854). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProfileInfo(DB::ProfileInfo const&) @ 0x0000000034ef8d6e in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:967: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x0000000034eef305 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:503: DB::TCPHandler::runImpl() @ 0x0000000034ed6fc7 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:08.854547 [ 3749 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:46: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f86 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:08.855773 [ 3736 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:46: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f86 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:08.857270 [ 3743 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:46: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f86 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:08.857403 [ 3877 ] {9e173f75-e2d2-4db3-85da-bf05e501f41b} TCPHandler: Client has gone away. 2024.10.22 00:24:08.858053 [ 1910 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:46: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f86 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:08.858655 [ 2843 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:46: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f86 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:08.859517 [ 2479 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:46: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f86 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:08.865959 [ 2526 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:46: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f86 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:12.333692 [ 2570 ] {a7614b23-8b0c-48dc-bb9a-88cd8e4ebf62} executeQuery: Code: 433. DB::Exception: Delta codec argument must be unsigned integer. (ILLEGAL_CODEC_PARAMETER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43890) (comment: 01296_codecs_bad_arguments.sql) (in query: CREATE TABLE delta_table (`id` UInt64 CODEC(Delta(tuple()))) ENGINE = MergeTree ORDER BY tuple() SETTINGS index_granularity = 61589, min_bytes_for_wide_part = 333406114, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 7707, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 10737418240, index_granularity_bytes = 20333962, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 82379, primary_key_compress_block_size = 88187), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [46]) @ 0x000000000cd316e9 in /usr/bin/clickhouse 3. ./build_docker/./src/Compression/CompressionCodecDelta.cpp:207: std::shared_ptr std::__function::__policy_invoker (std::shared_ptr const&, DB::IDataType const*)>::__call_impl (std::shared_ptr const&, DB::IDataType const*)>>(std::__function::__policy_storage const*, std::shared_ptr const&, DB::IDataType const*) @ 0x000000002ecaefe1 in /usr/bin/clickhouse 4. ./build_docker/./src/Compression/CompressionFactory.cpp:123: DB::CompressionCodecFactory::getImpl(String const&, std::shared_ptr const&, DB::IDataType const*) const @ 0x000000002ec92545 in /usr/bin/clickhouse 5. ./build_docker/./src/Compression/CompressionFactoryAdditions.cpp:135: void std::__function::__policy_invoker::__call_impl const&, std::shared_ptr const&, bool, bool, bool) const::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000031165beb in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::CompressionCodecFactory::validateCodecAndGetPreprocessedAST(std::shared_ptr const&, std::shared_ptr const&, bool, bool, bool) const @ 0x0000000031162739 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getColumnsDescription(DB::ASTExpressionList const&, std::shared_ptr, bool) @ 0x0000000030f3b59b in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x0000000030f3e558 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f50859 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:12.342499 [ 2570 ] {a7614b23-8b0c-48dc-bb9a-88cd8e4ebf62} TCPHandler: Code: 433. DB::Exception: Delta codec argument must be unsigned integer. (ILLEGAL_CODEC_PARAMETER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [46]) @ 0x000000000cd316e9 in /usr/bin/clickhouse 3. ./build_docker/./src/Compression/CompressionCodecDelta.cpp:207: std::shared_ptr std::__function::__policy_invoker (std::shared_ptr const&, DB::IDataType const*)>::__call_impl (std::shared_ptr const&, DB::IDataType const*)>>(std::__function::__policy_storage const*, std::shared_ptr const&, DB::IDataType const*) @ 0x000000002ecaefe1 in /usr/bin/clickhouse 4. ./build_docker/./src/Compression/CompressionFactory.cpp:123: DB::CompressionCodecFactory::getImpl(String const&, std::shared_ptr const&, DB::IDataType const*) const @ 0x000000002ec92545 in /usr/bin/clickhouse 5. ./build_docker/./src/Compression/CompressionFactoryAdditions.cpp:135: void std::__function::__policy_invoker::__call_impl const&, std::shared_ptr const&, bool, bool, bool) const::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000031165beb in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::CompressionCodecFactory::validateCodecAndGetPreprocessedAST(std::shared_ptr const&, std::shared_ptr const&, bool, bool, bool) const @ 0x0000000031162739 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getColumnsDescription(DB::ASTExpressionList const&, std::shared_ptr, bool) @ 0x0000000030f3b59b in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x0000000030f3e558 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f50859 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:12.431729 [ 2570 ] {41f32ab5-1543-4bd9-8a01-42269851a520} executeQuery: Code: 433. DB::Exception: ZSTD codec argument must be integer. (ILLEGAL_CODEC_PARAMETER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43890) (comment: 01296_codecs_bad_arguments.sql) (in query: CREATE TABLE zstd_table (`id` UInt64 CODEC(ZSTD(tuple()))) ENGINE = MergeTree ORDER BY tuple() SETTINGS index_granularity = 61589, min_bytes_for_wide_part = 333406114, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 7707, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 10737418240, index_granularity_bytes = 20333962, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 82379, primary_key_compress_block_size = 88187), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [36]) @ 0x000000000f5ba8e9 in /usr/bin/clickhouse 3. ./build_docker/./src/Compression/CompressionCodecZSTD.cpp:124: std::shared_ptr std::__function::__policy_invoker (std::shared_ptr const&)>::__call_impl (std::shared_ptr const&)>>(std::__function::__policy_storage const*, std::shared_ptr const&) @ 0x000000002eca55b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Compression/CompressionFactory.cpp:123: DB::CompressionCodecFactory::getImpl(String const&, std::shared_ptr const&, DB::IDataType const*) const @ 0x000000002ec92545 in /usr/bin/clickhouse 5. ./build_docker/./src/Compression/CompressionFactoryAdditions.cpp:135: void std::__function::__policy_invoker::__call_impl const&, std::shared_ptr const&, bool, bool, bool) const::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000031165beb in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::CompressionCodecFactory::validateCodecAndGetPreprocessedAST(std::shared_ptr const&, std::shared_ptr const&, bool, bool, bool) const @ 0x0000000031162739 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getColumnsDescription(DB::ASTExpressionList const&, std::shared_ptr, bool) @ 0x0000000030f3b59b in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x0000000030f3e558 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f50859 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:12.516242 [ 2570 ] {41f32ab5-1543-4bd9-8a01-42269851a520} TCPHandler: Code: 433. DB::Exception: ZSTD codec argument must be integer. (ILLEGAL_CODEC_PARAMETER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [36]) @ 0x000000000f5ba8e9 in /usr/bin/clickhouse 3. ./build_docker/./src/Compression/CompressionCodecZSTD.cpp:124: std::shared_ptr std::__function::__policy_invoker (std::shared_ptr const&)>::__call_impl (std::shared_ptr const&)>>(std::__function::__policy_storage const*, std::shared_ptr const&) @ 0x000000002eca55b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Compression/CompressionFactory.cpp:123: DB::CompressionCodecFactory::getImpl(String const&, std::shared_ptr const&, DB::IDataType const*) const @ 0x000000002ec92545 in /usr/bin/clickhouse 5. ./build_docker/./src/Compression/CompressionFactoryAdditions.cpp:135: void std::__function::__policy_invoker::__call_impl const&, std::shared_ptr const&, bool, bool, bool) const::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000031165beb in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::CompressionCodecFactory::validateCodecAndGetPreprocessedAST(std::shared_ptr const&, std::shared_ptr const&, bool, bool, bool) const @ 0x0000000031162739 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getColumnsDescription(DB::ASTExpressionList const&, std::shared_ptr, bool) @ 0x0000000030f3b59b in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x0000000030f3e558 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f50859 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:12.749820 [ 2570 ] {ba4f766f-9732-48d1-87bb-875e28b8bd7e} executeQuery: Code: 433. DB::Exception: LZ4HC codec argument must be integer. (ILLEGAL_CODEC_PARAMETER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43890) (comment: 01296_codecs_bad_arguments.sql) (in query: CREATE TABLE lz4_table (`id` UInt64 CODEC(LZ4HC(tuple()))) ENGINE = MergeTree ORDER BY tuple() SETTINGS index_granularity = 61589, min_bytes_for_wide_part = 333406114, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 7707, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 10737418240, index_granularity_bytes = 20333962, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 82379, primary_key_compress_block_size = 88187), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [37]) @ 0x000000000eb48d49 in /usr/bin/clickhouse 3. ./build_docker/./src/Compression/CompressionCodecLZ4.cpp:134: std::shared_ptr std::__function::__policy_invoker (std::shared_ptr const&)>::__call_impl (std::shared_ptr const&)>>(std::__function::__policy_storage const*, std::shared_ptr const&) @ 0x000000002eca2184 in /usr/bin/clickhouse 4. ./build_docker/./src/Compression/CompressionFactory.cpp:123: DB::CompressionCodecFactory::getImpl(String const&, std::shared_ptr const&, DB::IDataType const*) const @ 0x000000002ec92545 in /usr/bin/clickhouse 5. ./build_docker/./src/Compression/CompressionFactoryAdditions.cpp:135: void std::__function::__policy_invoker::__call_impl const&, std::shared_ptr const&, bool, bool, bool) const::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000031165beb in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::CompressionCodecFactory::validateCodecAndGetPreprocessedAST(std::shared_ptr const&, std::shared_ptr const&, bool, bool, bool) const @ 0x0000000031162739 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getColumnsDescription(DB::ASTExpressionList const&, std::shared_ptr, bool) @ 0x0000000030f3b59b in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x0000000030f3e558 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f50859 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:12.778548 [ 2570 ] {ba4f766f-9732-48d1-87bb-875e28b8bd7e} TCPHandler: Code: 433. DB::Exception: LZ4HC codec argument must be integer. (ILLEGAL_CODEC_PARAMETER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [37]) @ 0x000000000eb48d49 in /usr/bin/clickhouse 3. ./build_docker/./src/Compression/CompressionCodecLZ4.cpp:134: std::shared_ptr std::__function::__policy_invoker (std::shared_ptr const&)>::__call_impl (std::shared_ptr const&)>>(std::__function::__policy_storage const*, std::shared_ptr const&) @ 0x000000002eca2184 in /usr/bin/clickhouse 4. ./build_docker/./src/Compression/CompressionFactory.cpp:123: DB::CompressionCodecFactory::getImpl(String const&, std::shared_ptr const&, DB::IDataType const*) const @ 0x000000002ec92545 in /usr/bin/clickhouse 5. ./build_docker/./src/Compression/CompressionFactoryAdditions.cpp:135: void std::__function::__policy_invoker::__call_impl const&, std::shared_ptr const&, bool, bool, bool) const::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000031165beb in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::CompressionCodecFactory::validateCodecAndGetPreprocessedAST(std::shared_ptr const&, std::shared_ptr const&, bool, bool, bool) const @ 0x0000000031162739 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getColumnsDescription(DB::ASTExpressionList const&, std::shared_ptr, bool) @ 0x0000000030f3b59b in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x0000000030f3e558 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f50859 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:13.093060 [ 2570 ] {9f6029ca-dad7-4fa7-a064-b4d6d91cd5e9} executeQuery: Code: 378. DB::Exception: Compression codec LZ4 cannot have arguments. (DATA_TYPE_CANNOT_HAVE_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43890) (comment: 01296_codecs_bad_arguments.sql) (in query: CREATE TABLE lz4_table (`id` UInt64 CODEC(LZ4(tuple()))) ENGINE = MergeTree ORDER BY tuple() SETTINGS index_granularity = 61589, min_bytes_for_wide_part = 333406114, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 7707, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 10737418240, index_granularity_bytes = 20333962, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 82379, primary_key_compress_block_size = 88187), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Compression/CompressionFactory.cpp:160: std::shared_ptr std::__function::__policy_invoker (std::shared_ptr const&)>::__call_impl, std::function ()>)::$_0, std::shared_ptr (std::shared_ptr const&)>>(std::__function::__policy_storage const*, std::shared_ptr const&) @ 0x000000002ec95a3c in /usr/bin/clickhouse 4. ./build_docker/./src/Compression/CompressionFactory.cpp:123: DB::CompressionCodecFactory::getImpl(String const&, std::shared_ptr const&, DB::IDataType const*) const @ 0x000000002ec92545 in /usr/bin/clickhouse 5. ./build_docker/./src/Compression/CompressionFactoryAdditions.cpp:135: void std::__function::__policy_invoker::__call_impl const&, std::shared_ptr const&, bool, bool, bool) const::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000031165beb in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::CompressionCodecFactory::validateCodecAndGetPreprocessedAST(std::shared_ptr const&, std::shared_ptr const&, bool, bool, bool) const @ 0x0000000031162739 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getColumnsDescription(DB::ASTExpressionList const&, std::shared_ptr, bool) @ 0x0000000030f3b59b in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x0000000030f3e558 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f50859 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:13.128406 [ 2570 ] {9f6029ca-dad7-4fa7-a064-b4d6d91cd5e9} TCPHandler: Code: 378. DB::Exception: Compression codec LZ4 cannot have arguments. (DATA_TYPE_CANNOT_HAVE_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Compression/CompressionFactory.cpp:160: std::shared_ptr std::__function::__policy_invoker (std::shared_ptr const&)>::__call_impl, std::function ()>)::$_0, std::shared_ptr (std::shared_ptr const&)>>(std::__function::__policy_storage const*, std::shared_ptr const&) @ 0x000000002ec95a3c in /usr/bin/clickhouse 4. ./build_docker/./src/Compression/CompressionFactory.cpp:123: DB::CompressionCodecFactory::getImpl(String const&, std::shared_ptr const&, DB::IDataType const*) const @ 0x000000002ec92545 in /usr/bin/clickhouse 5. ./build_docker/./src/Compression/CompressionFactoryAdditions.cpp:135: void std::__function::__policy_invoker::__call_impl const&, std::shared_ptr const&, bool, bool, bool) const::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000031165beb in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::CompressionCodecFactory::validateCodecAndGetPreprocessedAST(std::shared_ptr const&, std::shared_ptr const&, bool, bool, bool) const @ 0x0000000031162739 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getColumnsDescription(DB::ASTExpressionList const&, std::shared_ptr, bool) @ 0x0000000030f3b59b in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x0000000030f3e558 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f50859 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:14.209251 [ 3272 ] {8de4eeeb-d96c-4ff0-ad6a-d03dfa367316} executeQuery: Code: 60. DB::Exception: Table test_11.async_inserts (4c937601-27cc-4df9-b297-8dbeb0875130) does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 02015_async_inserts_stress_long.sh) (in query: INSERT INTO test_11.async_inserts FORMAT CSV), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:345: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb26639 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.cpp:517: DB::AsynchronousInsertQueue::processData(DB::AsynchronousInsertQueue::InsertQuery, std::unique_ptr>, std::shared_ptr) @ 0x000000002f8a89cf in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.h:50: void std::__function::__policy_invoker::__call_impl>, std::shared_ptr)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000002f8b1cf5 in /usr/bin/clickhouse 9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 10. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:14.211163 [ 3272 ] {} AsynchronousInsertQueue: Failed insertion for query 'INSERT INTO test_11.async_inserts FORMAT CSV': Code: 60. DB::Exception: Table test_11.async_inserts (4c937601-27cc-4df9-b297-8dbeb0875130) does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:345: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb26639 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.cpp:517: DB::AsynchronousInsertQueue::processData(DB::AsynchronousInsertQueue::InsertQuery, std::unique_ptr>, std::shared_ptr) @ 0x000000002f8a89cf in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.h:50: void std::__function::__policy_invoker::__call_impl>, std::shared_ptr)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000002f8b1cf5 in /usr/bin/clickhouse 9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 10. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:14.212825 [ 3278 ] {58d49cde-ae38-4fbc-802d-d86d3ebc1ee5} executeQuery: Code: 60. DB::Exception: Table test_11.async_inserts (4c937601-27cc-4df9-b297-8dbeb0875130) does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 02015_async_inserts_stress_long.sh) (in query: INSERT INTO test_11.async_inserts FORMAT JSONEachRow), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:345: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb26639 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.cpp:517: DB::AsynchronousInsertQueue::processData(DB::AsynchronousInsertQueue::InsertQuery, std::unique_ptr>, std::shared_ptr) @ 0x000000002f8a89cf in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.h:50: void std::__function::__policy_invoker::__call_impl>, std::shared_ptr)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000002f8b1cf5 in /usr/bin/clickhouse 9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 10. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:14.214761 [ 3278 ] {} AsynchronousInsertQueue: Failed insertion for query 'INSERT INTO test_11.async_inserts FORMAT JSONEachRow': Code: 60. DB::Exception: Table test_11.async_inserts (4c937601-27cc-4df9-b297-8dbeb0875130) does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:345: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb26639 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.cpp:517: DB::AsynchronousInsertQueue::processData(DB::AsynchronousInsertQueue::InsertQuery, std::unique_ptr>, std::shared_ptr) @ 0x000000002f8a89cf in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.h:50: void std::__function::__policy_invoker::__call_impl>, std::shared_ptr)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000002f8b1cf5 in /usr/bin/clickhouse 9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 10. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:14.555791 [ 2758 ] {96d768a6-f7e8-47ce-a734-a5aa15b8f5ea} executeQuery: Code: 60. DB::Exception: Table test_11.async_inserts does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 02015_async_inserts_stress_long.sh) (in query: INSERT INTO FUNCTION remote('127.0.0.1', 'test_11', 'async_inserts') FORMAT Values), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/getStructureOfRemoteTable.cpp:0: DB::getStructureOfRemoteTableInShard(DB::Cluster const&, DB::Cluster::ShardInfo const&, DB::StorageID const&, std::shared_ptr, std::shared_ptr const&) @ 0x0000000033706626 in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/getStructureOfRemoteTable.cpp:139: DB::getStructureOfRemoteTable(DB::Cluster const&, DB::StorageID const&, std::shared_ptr, std::shared_ptr const&) @ 0x000000003371057b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TableFunctionRemote::getActualTableStructure(std::shared_ptr, bool) const @ 0x000000002d0fba8f in /usr/bin/clickhouse 9. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:0: DB::TableFunctionRemote::executeImpl(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool) const @ 0x000000002d0f931f in /usr/bin/clickhouse 10. ./build_docker/./src/TableFunctions/ITableFunction.cpp:37: DB::ITableFunction::execute(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool, bool) const @ 0x000000002d8e42eb in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:105: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a2a6e in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.cpp:517: DB::AsynchronousInsertQueue::processData(DB::AsynchronousInsertQueue::InsertQuery, std::unique_ptr>, std::shared_ptr) @ 0x000000002f8a89cf in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.h:50: void std::__function::__policy_invoker::__call_impl>, std::shared_ptr)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000002f8b1cf5 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:14.560415 [ 2758 ] {} AsynchronousInsertQueue: Failed insertion for query 'INSERT INTO FUNCTION remote('127.0.0.1', 'test_11', 'async_inserts') FORMAT Values': Code: 60. DB::Exception: Table test_11.async_inserts does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/getStructureOfRemoteTable.cpp:0: DB::getStructureOfRemoteTableInShard(DB::Cluster const&, DB::Cluster::ShardInfo const&, DB::StorageID const&, std::shared_ptr, std::shared_ptr const&) @ 0x0000000033706626 in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/getStructureOfRemoteTable.cpp:139: DB::getStructureOfRemoteTable(DB::Cluster const&, DB::StorageID const&, std::shared_ptr, std::shared_ptr const&) @ 0x000000003371057b in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TableFunctionRemote::getActualTableStructure(std::shared_ptr, bool) const @ 0x000000002d0fba8f in /usr/bin/clickhouse 9. ./build_docker/./src/TableFunctions/TableFunctionRemote.cpp:0: DB::TableFunctionRemote::executeImpl(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool) const @ 0x000000002d0f931f in /usr/bin/clickhouse 10. ./build_docker/./src/TableFunctions/ITableFunction.cpp:37: DB::ITableFunction::execute(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool, bool) const @ 0x000000002d8e42eb in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:105: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a2a6e in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.cpp:517: DB::AsynchronousInsertQueue::processData(DB::AsynchronousInsertQueue::InsertQuery, std::unique_ptr>, std::shared_ptr) @ 0x000000002f8a89cf in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.h:50: void std::__function::__policy_invoker::__call_impl>, std::shared_ptr)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000002f8b1cf5 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:17.048436 [ 3736 ] {ef635d5c-ec6c-43e5-b9d6-af7d97157bd2} executeQuery: Code: 42. DB::Exception: ARRAY JOIN requires an argument. (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43968) (comment: 00011_array_join_alias.sql) (in query: SELECT x, a FROM (SELECT arrayJoin(['Hello', 'Goodbye']) AS x, [1, 2, 3] AS arr) ARRAY JOIN;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [32]) @ 0x0000000019099289 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf439 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:17.066622 [ 3736 ] {ef635d5c-ec6c-43e5-b9d6-af7d97157bd2} TCPHandler: Code: 42. DB::Exception: ARRAY JOIN requires an argument. (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [32]) @ 0x0000000019099289 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf439 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:24.234888 [ 3160 ] {5c13777f-84c7-492d-bfb9-fe8b0bd9f6e8} MergeTreeDataWriter: Incorrect data: number of rows with sign = 1 (9000) differs with number of rows with sign = -1 (0) by more than one (for key: 0, 0).). 2024.10.22 00:24:34.608839 [ 3829 ] {d3d2dda8-49ea-4e45-b22b-34aaa324b78f} executeQuery: Code: 27. DB::ParsingException: Cannot parse input: expected '\t' at end of stream.: Buffer has gone, cannot extract information about what has been parsed.: While executing TabSeparatedRowInputFormat: (at row 1) . (CANNOT_PARSE_INPUT_ASSERTION_FAILED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:33626) (comment: 01271_http_code_parse_error.sh) (in query: insert into test (f1, f2) format TSV ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ParsingException::ParsingException(int, FormatStringHelperImpl::type>, String&) @ 0x000000001d74739e in /usr/bin/clickhouse 3. ./build_docker/./src/IO/ReadHelpers.cpp:92: DB::throwAtAssertionFailed(char const*, DB::ReadBuffer&) @ 0x000000001d70c7c8 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/ReadBuffer.h:73: DB::TabSeparatedFormatReader::skipFieldDelimiter() @ 0x00000000356a88e5 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Formats/RowInputFormatWithNamesAndTypes.cpp:0: DB::RowInputFormatWithNamesAndTypes::readRow(std::vector::mutable_ptr, std::allocator::mutable_ptr>>&, DB::RowReadExtension&) @ 0x000000003520f608 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x0000000035167db7 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:111: DB::CompletedPipelineExecutor::execute() @ 0x0000000034ff9b73 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1421: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320fa883 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 16. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:34.610893 [ 3829 ] {d3d2dda8-49ea-4e45-b22b-34aaa324b78f} DynamicQueryHandler: Code: 27. DB::ParsingException: Cannot parse input: expected '\t' at end of stream.: Buffer has gone, cannot extract information about what has been parsed.: While executing TabSeparatedRowInputFormat: (at row 1) . (CANNOT_PARSE_INPUT_ASSERTION_FAILED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ParsingException::ParsingException(int, FormatStringHelperImpl::type>, String&) @ 0x000000001d74739e in /usr/bin/clickhouse 3. ./build_docker/./src/IO/ReadHelpers.cpp:92: DB::throwAtAssertionFailed(char const*, DB::ReadBuffer&) @ 0x000000001d70c7c8 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/ReadBuffer.h:73: DB::TabSeparatedFormatReader::skipFieldDelimiter() @ 0x00000000356a88e5 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Formats/RowInputFormatWithNamesAndTypes.cpp:0: DB::RowInputFormatWithNamesAndTypes::readRow(std::vector::mutable_ptr, std::allocator::mutable_ptr>>&, DB::RowReadExtension&) @ 0x000000003520f608 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x0000000035167db7 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:111: DB::CompletedPipelineExecutor::execute() @ 0x0000000034ff9b73 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1421: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320fa883 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 16. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:40.575430 [ 3732 ] {f94b7ed7-6240-4dd4-a022-f322c18a6252::19700101_19700101_1_3_1} CollapsingSortedTransform: Incorrect data: number of rows with sign = 1 (2) differs with number of rows with sign = -1 (0) by more than one (for key: 0, 0).). 2024.10.22 00:24:40.588192 [ 3732 ] {f94b7ed7-6240-4dd4-a022-f322c18a6252::19700101_19700101_1_3_1} CollapsingSortedTransform: Incorrect data: number of rows with sign = 1 (2) differs with number of rows with sign = -1 (0) by more than one (for key: 0, 9000).). 2024.10.22 00:24:40.589197 [ 3732 ] {f94b7ed7-6240-4dd4-a022-f322c18a6252::19700101_19700101_1_3_1} CollapsingSortedTransform: Incorrect data: number of rows with sign = 1 (2) differs with number of rows with sign = -1 (0) by more than one (for key: 0, 9001).). 2024.10.22 00:24:40.589599 [ 3732 ] {f94b7ed7-6240-4dd4-a022-f322c18a6252::19700101_19700101_1_3_1} CollapsingSortedTransform: Incorrect data: number of rows with sign = 1 (2) differs with number of rows with sign = -1 (0) by more than one (for key: 0, 9002).). 2024.10.22 00:24:40.590005 [ 3732 ] {f94b7ed7-6240-4dd4-a022-f322c18a6252::19700101_19700101_1_3_1} CollapsingSortedTransform: Incorrect data: number of rows with sign = 1 (2) differs with number of rows with sign = -1 (0) by more than one (for key: 0, 9003).). 2024.10.22 00:24:40.590409 [ 3732 ] {f94b7ed7-6240-4dd4-a022-f322c18a6252::19700101_19700101_1_3_1} CollapsingSortedTransform: Incorrect data: number of rows with sign = 1 (2) differs with number of rows with sign = -1 (0) by more than one (for key: 0, 9004).). 2024.10.22 00:24:40.590980 [ 3732 ] {f94b7ed7-6240-4dd4-a022-f322c18a6252::19700101_19700101_1_3_1} CollapsingSortedTransform: Incorrect data: number of rows with sign = 1 (2) differs with number of rows with sign = -1 (0) by more than one (for key: 0, 9005).). 2024.10.22 00:24:40.593539 [ 3732 ] {f94b7ed7-6240-4dd4-a022-f322c18a6252::19700101_19700101_1_3_1} CollapsingSortedTransform: Incorrect data: number of rows with sign = 1 (2) differs with number of rows with sign = -1 (0) by more than one (for key: 0, 9006).). 2024.10.22 00:24:40.593948 [ 3732 ] {f94b7ed7-6240-4dd4-a022-f322c18a6252::19700101_19700101_1_3_1} CollapsingSortedTransform: Incorrect data: number of rows with sign = 1 (2) differs with number of rows with sign = -1 (0) by more than one (for key: 0, 9007).). 2024.10.22 00:24:40.601008 [ 3732 ] {f94b7ed7-6240-4dd4-a022-f322c18a6252::19700101_19700101_1_3_1} CollapsingSortedTransform: Incorrect data: number of rows with sign = 1 (2) differs with number of rows with sign = -1 (0) by more than one (for key: 0, 9008).). 2024.10.22 00:24:42.136083 [ 3746 ] {ae55dbb0-4f41-419b-85b5-8de6b006425f} executeQuery: Code: 36. DB::Exception: index_granularity_bytes: 1 is lower than specified min_index_granularity_bytes: 1024. (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59048) (comment: 01457_min_index_granularity_bytes_setting.sql) (in query: CREATE TABLE invalid_min_index_granularity_bytes_setting (`id` UInt64, `value` String) ENGINE = MergeTree ORDER BY id SETTINGS index_granularity_bytes = 1, min_index_granularity_bytes = 1024, index_granularity = 22754, min_bytes_for_wide_part = 0, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 13871, prefer_fetch_merged_part_size_threshold = 3854867626, vertical_merge_algorithm_min_rows_to_activate = 594106, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 1, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 81896, primary_key_compress_block_size = 13789), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception const&, DB::SettingFieldNumber const&>(int, FormatStringHelperImpl const&>::type, std::type_identity const&>::type>, DB::SettingFieldNumber const&, DB::SettingFieldNumber const&) @ 0x0000000034557f1d in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeSettings.cpp:171: DB::MergeTreeSettings::sanityCheck(unsigned long) const @ 0x00000000344f4c45 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeData::MergeTreeData(DB::StorageID const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, bool, std::function) @ 0x0000000033ef7744 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/StorageMergeTree.cpp:101: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa3cf in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:42.152473 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {51a4a7c5-1863-4af2-93d2-5ec08016b936::202410_1_6_1}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x000000001d610bdd in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x000000001d60c57c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::finish() @ 0x000000003499483e in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992afd in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:42.154768 [ 3746 ] {ae55dbb0-4f41-419b-85b5-8de6b006425f} TCPHandler: Code: 36. DB::Exception: index_granularity_bytes: 1 is lower than specified min_index_granularity_bytes: 1024. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception const&, DB::SettingFieldNumber const&>(int, FormatStringHelperImpl const&>::type, std::type_identity const&>::type>, DB::SettingFieldNumber const&, DB::SettingFieldNumber const&) @ 0x0000000034557f1d in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeSettings.cpp:171: DB::MergeTreeSettings::sanityCheck(unsigned long) const @ 0x00000000344f4c45 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeData::MergeTreeData(DB::StorageID const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, bool, std::function) @ 0x0000000033ef7744 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/StorageMergeTree.cpp:101: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa3cf in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:42.451489 [ 3745 ] {0ac9b77f-0ec8-4be2-a59f-db7efcdd5777} executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59068) (comment: 03142_untuple_crash.sql) (in query: SET allow_experimental_analyzer=1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:42.453382 [ 3745 ] {0ac9b77f-0ec8-4be2-a59f-db7efcdd5777} TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:45.044669 [ 2541 ] {96a9adb3-b4b1-4749-8b96-4b762bdd9068} DynamicQueryHandler: Code: 246. DB::Exception: Too large uncompressed size: 4294967295. (CORRUPTED_DATA), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned int&) @ 0x000000002d9b6048 in /usr/bin/clickhouse 3. ./build_docker/./src/Compression/CompressionCodecMultiple.cpp:106: DB::CompressionCodecMultiple::doDecompressData(char const*, unsigned int, char*, unsigned int) const @ 0x000000002eca974d in /usr/bin/clickhouse 4. ./build_docker/./src/Compression/ICompressionCodec.cpp:113: DB::ICompressionCodec::decompress(char const*, unsigned int, char*) const @ 0x000000002ed28447 in /usr/bin/clickhouse 5. ./build_docker/./src/Compression/CompressedReadBufferBase.cpp:0: DB::CompressedReadBufferBase::decompress(DB::BufferBase::Buffer&, unsigned long, unsigned long) @ 0x000000002ec75cde in /usr/bin/clickhouse 6. ./build_docker/./src/Compression/CompressedReadBuffer.cpp:0: non-virtual thunk to DB::CompressedReadBuffer::nextImpl() @ 0x000000002ec70806 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/ReadBuffer.h:71: DB::(anonymous namespace)::ReadBufferWrapper::nextImpl() @ 0x000000002e5ce25b in /usr/bin/clickhouse 8. ./build_docker/./src/IO/ReadBuffer.h:72: DB::ConcatReadBuffer::nextImpl() @ 0x000000002f8bdd63 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/ReadBuffer.h:72: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f7610 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 11. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:45.413480 [ 2541 ] {f67aea0e-6473-4c03-8690-3fa5ec1bc4dd} DynamicQueryHandler: Code: 246. DB::Exception: Wrong data for compression codec NONE: source_size (278) != uncompressed_size (33686018). (CORRUPTED_DATA), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, unsigned int&, unsigned int&) @ 0x000000002d0ddf21 in /usr/bin/clickhouse 3. ./build_docker/./src/Compression/CompressionCodecNone.cpp:38: DB::CompressionCodecNone::doDecompressData(char const*, unsigned int, char*, unsigned int) const @ 0x000000002ec9f892 in /usr/bin/clickhouse 4. ./build_docker/./src/Compression/ICompressionCodec.cpp:113: DB::ICompressionCodec::decompress(char const*, unsigned int, char*) const @ 0x000000002ed28447 in /usr/bin/clickhouse 5. ./build_docker/./src/Compression/CompressionCodecMultiple.cpp:0: DB::CompressionCodecMultiple::doDecompressData(char const*, unsigned int, char*, unsigned int) const @ 0x000000002eca8f84 in /usr/bin/clickhouse 6. ./build_docker/./src/Compression/ICompressionCodec.cpp:113: DB::ICompressionCodec::decompress(char const*, unsigned int, char*) const @ 0x000000002ed28447 in /usr/bin/clickhouse 7. ./build_docker/./src/Compression/CompressedReadBufferBase.cpp:0: DB::CompressedReadBufferBase::decompress(DB::BufferBase::Buffer&, unsigned long, unsigned long) @ 0x000000002ec75cde in /usr/bin/clickhouse 8. ./build_docker/./src/Compression/CompressedReadBuffer.cpp:0: non-virtual thunk to DB::CompressedReadBuffer::nextImpl() @ 0x000000002ec70806 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/ReadBuffer.h:71: DB::(anonymous namespace)::ReadBufferWrapper::nextImpl() @ 0x000000002e5ce25b in /usr/bin/clickhouse 10. ./build_docker/./src/IO/ReadBuffer.h:72: DB::ConcatReadBuffer::nextImpl() @ 0x000000002f8bdd63 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/ReadBuffer.h:72: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f7610 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:24:47.151978 [ 2541 ] {11123401-b5ac-43f5-ae72-feb13609b46d} executeQuery: Code: 36. DB::Exception: Incorrect argument 2 type of function arrayEnumerateUniqRanked. Expected an Array or Const(UInt64), got UInt8: While processing arrayEnumerateUniqRanked(arrayEnumerateUniqRanked([[1, 2, 3], [2, 2, 1], [3]]), materialize(1 AS x) OR toLowCardinality(-9223372036854775808)). (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59136) (comment: 03003_arrayEnumerate_crash.sql) (in query: SELECT arrayEnumerateUniqRanked(arrayEnumerateUniqRanked([[1, 2, 3], [2, 2, 1], [3]]), materialize(1 AS x) OR toLowCardinality(-9223372036854775808));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, char const*&, String&&) @ 0x000000001c88fd59 in /usr/bin/clickhouse 3. DB::getArraysDepths(std::vector> const&, char const*) @ 0x000000001c88e785 in /usr/bin/clickhouse 4. DB::FunctionArrayEnumerateRankedExtended::getReturnTypeImpl(std::vector> const&) const @ 0x000000001c8c4ceb in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:24:47.283187 [ 2541 ] {11123401-b5ac-43f5-ae72-feb13609b46d} TCPHandler: Code: 36. DB::Exception: Incorrect argument 2 type of function arrayEnumerateUniqRanked. Expected an Array or Const(UInt64), got UInt8: While processing arrayEnumerateUniqRanked(arrayEnumerateUniqRanked([[1, 2, 3], [2, 2, 1], [3]]), materialize(1 AS x) OR toLowCardinality(-9223372036854775808)). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, char const*&, String&&) @ 0x000000001c88fd59 in /usr/bin/clickhouse 3. DB::getArraysDepths(std::vector> const&, char const*) @ 0x000000001c88e785 in /usr/bin/clickhouse 4. DB::FunctionArrayEnumerateRankedExtended::getReturnTypeImpl(std::vector> const&) const @ 0x000000001c8c4ceb in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:24:47.283871 [ 2526 ] {388cb338-c650-4442-ae2c-41ba8cad9e0f} executeQuery: Code: 60. DB::Exception: Table shard_1.data_01850 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59160) (comment: 01850_dist_INSERT_preserve_error.sql) (in query: INSERT INTO data_01850 (key) VALUES), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:47.289451 [ 2526 ] {388cb338-c650-4442-ae2c-41ba8cad9e0f} TCPHandler: Code: 60. DB::Exception: Table shard_1.data_01850 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:47.333543 [ 2479 ] {a41f4c90-94b6-4f85-9ec5-a9288fc78625} executeQuery: Code: 60. DB::Exception: Received from localhost:9000. DB::Exception: Table shard_1.data_01850 does not exist. Stack trace: 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? : Insertion status: Wrote 1 blocks and 1 rows on shard 0 replica 0, localhost:9000 (average 170 ms per block) Wrote 0 blocks and 0 rows on shard 0 replica 1, localhost:9000 (average 297 ms per block) . (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59126) (comment: 01850_dist_INSERT_preserve_error.sql) (in query: insert into dist_01850 values ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x000000001d7167e4 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x0000000034c029ec in /usr/bin/clickhouse 4. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::receivePacket() @ 0x0000000034c17b8e in /usr/bin/clickhouse 5. ./build_docker/./src/QueryPipeline/RemoteInserter.cpp:61: DB::RemoteInserter::RemoteInserter(DB::Connection&, DB::ConnectionTimeouts const&, String const&, DB::Settings const&, DB::ClientInfo const&) @ 0x0000000033c0d34b in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Sinks/RemoteSink.h:0: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033c58391 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 11. ? @ 0x00007f11b339dac3 in ? 12. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:47.368072 [ 2479 ] {a41f4c90-94b6-4f85-9ec5-a9288fc78625} TCPHandler: Code: 60. DB::Exception: Received from localhost:9000. DB::Exception: Table shard_1.data_01850 does not exist. Stack trace: 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? : Insertion status: Wrote 1 blocks and 1 rows on shard 0 replica 0, localhost:9000 (average 170 ms per block) Wrote 0 blocks and 0 rows on shard 0 replica 1, localhost:9000 (average 297 ms per block) . (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x000000001d7167e4 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x0000000034c029ec in /usr/bin/clickhouse 4. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::receivePacket() @ 0x0000000034c17b8e in /usr/bin/clickhouse 5. ./build_docker/./src/QueryPipeline/RemoteInserter.cpp:61: DB::RemoteInserter::RemoteInserter(DB::Connection&, DB::ConnectionTimeouts const&, String const&, DB::Settings const&, DB::ClientInfo const&) @ 0x0000000033c0d34b in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Sinks/RemoteSink.h:0: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033c58391 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 11. ? @ 0x00007f11b339dac3 in ? 12. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:47.410588 [ 2479 ] {} TCPHandler: Code: 101. DB::NetException: Unexpected packet Data received from client. (UNEXPECTED_PACKET_FROM_CLIENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, char const (&) [44]) @ 0x0000000034f1d2ee in /usr/bin/clickhouse 3. ./build_docker/./src/Server/TCPHandler.cpp:1848: DB::TCPHandler::receiveUnexpectedData(bool) @ 0x0000000034f0c848 in /usr/bin/clickhouse 4. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x0000000034eec3ef in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed58db in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 11. ? @ 0x00007f11b339dac3 in ? 12. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:24:47.642663 [ 2541 ] {5ed5b67e-f5bb-43ad-8815-addf1ebbe514} executeQuery: Code: 36. DB::Exception: Incorrect argument 2 type of function arrayEnumerateUniqRanked. Expected an Array or Const(UInt64), got UInt64: While processing arrayEnumerateUniqRanked([[1, 2, 3], [2, 2, 1], [3]], number). (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59136) (comment: 03003_arrayEnumerate_crash.sql) (in query: SELECT arrayEnumerateUniqRanked([[1, 2, 3], [2, 2, 1], [3]], number) FROM numbers(10);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, char const*&, String&&) @ 0x000000001c88fd59 in /usr/bin/clickhouse 3. DB::getArraysDepths(std::vector> const&, char const*) @ 0x000000001c88e785 in /usr/bin/clickhouse 4. DB::FunctionArrayEnumerateRankedExtended::getReturnTypeImpl(std::vector> const&) const @ 0x000000001c8c4ceb in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:24:47.649704 [ 2541 ] {5ed5b67e-f5bb-43ad-8815-addf1ebbe514} TCPHandler: Code: 36. DB::Exception: Incorrect argument 2 type of function arrayEnumerateUniqRanked. Expected an Array or Const(UInt64), got UInt64: While processing arrayEnumerateUniqRanked([[1, 2, 3], [2, 2, 1], [3]], number). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, char const*&, String&&) @ 0x000000001c88fd59 in /usr/bin/clickhouse 3. DB::getArraysDepths(std::vector> const&, char const*) @ 0x000000001c88e785 in /usr/bin/clickhouse 4. DB::FunctionArrayEnumerateRankedExtended::getReturnTypeImpl(std::vector> const&) const @ 0x000000001c8c4ceb in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:25:00.687638 [ 2570 ] {91b5e926-4ef8-4303-b00b-336da89e9409} executeQuery: Code: 43. DB::Exception: Values for sumMap cannot be summed, passed type Nullable(Nothing): While processing initializeAggregation('sumMap', [1, 2, 1], [1, 1, 1], [NULL, NULL, NULL]). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56072) (comment: 01634_sum_map_nulls.sql) (in query: SELECT initializeAggregation('sumMap', [1, 2, 1], [1, 1, 1], [null, null, null]);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000e33d536 in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionSumMap.h:133: DB::AggregateFunctionMapBase, DB::FieldVisitorSum, false, false, true>::createResultType(std::shared_ptr const&, std::vector, std::allocator>> const&, String const&) @ 0x00000000233ffe21 in /usr/bin/clickhouse 4. ./build_docker/./src/AggregateFunctions/AggregateFunctionSumMap.h:0: DB::AggregateFunctionMapBase, DB::FieldVisitorSum, false, false, true>::AggregateFunctionMapBase(std::shared_ptr const&, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x00000000233f305c in /usr/bin/clickhouse 5. ./build_docker/./src/AggregateFunctions/AggregateFunctionSumMap.h:446: DB::AggregateFunctionSumMap::AggregateFunctionSumMap(std::shared_ptr const&, std::vector, std::allocator>>&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x00000000233ef651 in /usr/bin/clickhouse 6. ./build_docker/./src/AggregateFunctions/Helpers.h:0: std::shared_ptr DB::(anonymous namespace)::createAggregateFunctionMap::DispatchOnTupleArgument>(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::Settings const*) @ 0x00000000231e1ed4 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d34d3 in /usr/bin/clickhouse 8. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 9. ./build_docker/./src/AggregateFunctions/AggregateFunctionMap.cpp:124: DB::AggregateFunctionCombinatorMap::transformAggregateFunction(std::shared_ptr const&, DB::AggregateFunctionProperties const&, std::vector, std::allocator>> const&, DB::Array const&) const @ 0x0000000026653ba9 in /usr/bin/clickhouse 10. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d2f21 in /usr/bin/clickhouse 11. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 12. DB::(anonymous namespace)::FunctionInitializeAggregation::getReturnTypeImpl(std::vector> const&) const @ 0x0000000014156ac6 in /usr/bin/clickhouse 13. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:25:00.853334 [ 3737 ] {19cdf57a-6194-465d-9f0d-37c871cb5340} executeQuery: Code: 450. DB::Exception: TTL expression result column should have DateTime or Date type, but has Int32. (BAD_TTL_EXPRESSION) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 00933_alter_ttl.sql) (in query: /* ddl_entry=query-0000000006 */ ALTER TABLE test_5.ttl MODIFY TTL a), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/TTLDescription.cpp:77: DB::TTLDescription::getTTLFromAST(std::shared_ptr const&, DB::ColumnsDescription const&, std::shared_ptr, DB::KeyDescription const&) @ 0x00000000336d5d2b in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/TTLDescription.cpp:342: DB::TTLTableDescription::getTTLForTableFromAST(std::shared_ptr const&, DB::ColumnsDescription const&, std::shared_ptr, DB::KeyDescription const&) @ 0x00000000336d863a in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/AlterCommands.cpp:613: DB::AlterCommand::apply(DB::StorageInMemoryMetadata&, std::shared_ptr) const @ 0x0000000032be116a in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::AlterCommands::apply(DB::StorageInMemoryMetadata&, std::shared_ptr) const @ 0x0000000032beed7c in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:3145: DB::MergeTreeData::checkAlterIsPossible(DB::AlterCommands const&, std::shared_ptr) const @ 0x0000000033f7cfda in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112ca7a in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 14. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 15. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000311292be in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 21. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:00.853044 [ 2570 ] {91b5e926-4ef8-4303-b00b-336da89e9409} TCPHandler: Code: 43. DB::Exception: Values for sumMap cannot be summed, passed type Nullable(Nothing): While processing initializeAggregation('sumMap', [1, 2, 1], [1, 1, 1], [NULL, NULL, NULL]). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000e33d536 in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionSumMap.h:133: DB::AggregateFunctionMapBase, DB::FieldVisitorSum, false, false, true>::createResultType(std::shared_ptr const&, std::vector, std::allocator>> const&, String const&) @ 0x00000000233ffe21 in /usr/bin/clickhouse 4. ./build_docker/./src/AggregateFunctions/AggregateFunctionSumMap.h:0: DB::AggregateFunctionMapBase, DB::FieldVisitorSum, false, false, true>::AggregateFunctionMapBase(std::shared_ptr const&, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x00000000233f305c in /usr/bin/clickhouse 5. ./build_docker/./src/AggregateFunctions/AggregateFunctionSumMap.h:446: DB::AggregateFunctionSumMap::AggregateFunctionSumMap(std::shared_ptr const&, std::vector, std::allocator>>&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x00000000233ef651 in /usr/bin/clickhouse 6. ./build_docker/./src/AggregateFunctions/Helpers.h:0: std::shared_ptr DB::(anonymous namespace)::createAggregateFunctionMap::DispatchOnTupleArgument>(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::Settings const*) @ 0x00000000231e1ed4 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d34d3 in /usr/bin/clickhouse 8. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 9. ./build_docker/./src/AggregateFunctions/AggregateFunctionMap.cpp:124: DB::AggregateFunctionCombinatorMap::transformAggregateFunction(std::shared_ptr const&, DB::AggregateFunctionProperties const&, std::vector, std::allocator>> const&, DB::Array const&) const @ 0x0000000026653ba9 in /usr/bin/clickhouse 10. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d2f21 in /usr/bin/clickhouse 11. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 12. DB::(anonymous namespace)::FunctionInitializeAggregation::getReturnTypeImpl(std::vector> const&) const @ 0x0000000014156ac6 in /usr/bin/clickhouse 13. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:25:00.884151 [ 3737 ] {19cdf57a-6194-465d-9f0d-37c871cb5340} executeQuery: Code: 450. DB::Exception: TTL expression result column should have DateTime or Date type, but has Int32. (BAD_TTL_EXPRESSION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59108) (comment: 00933_alter_ttl.sql) (in query: alter table ttl modify ttl a;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/TTLDescription.cpp:77: DB::TTLDescription::getTTLFromAST(std::shared_ptr const&, DB::ColumnsDescription const&, std::shared_ptr, DB::KeyDescription const&) @ 0x00000000336d5d2b in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/TTLDescription.cpp:342: DB::TTLTableDescription::getTTLForTableFromAST(std::shared_ptr const&, DB::ColumnsDescription const&, std::shared_ptr, DB::KeyDescription const&) @ 0x00000000336d863a in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/AlterCommands.cpp:613: DB::AlterCommand::apply(DB::StorageInMemoryMetadata&, std::shared_ptr) const @ 0x0000000032be116a in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::AlterCommands::apply(DB::StorageInMemoryMetadata&, std::shared_ptr) const @ 0x0000000032beed7c in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:3145: DB::MergeTreeData::checkAlterIsPossible(DB::AlterCommands const&, std::shared_ptr) const @ 0x0000000033f7cfda in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112ca7a in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 14. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 15. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000311292be in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 21. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:00.885768 [ 3737 ] {19cdf57a-6194-465d-9f0d-37c871cb5340} TCPHandler: Code: 450. DB::Exception: TTL expression result column should have DateTime or Date type, but has Int32. (BAD_TTL_EXPRESSION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/TTLDescription.cpp:77: DB::TTLDescription::getTTLFromAST(std::shared_ptr const&, DB::ColumnsDescription const&, std::shared_ptr, DB::KeyDescription const&) @ 0x00000000336d5d2b in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/TTLDescription.cpp:342: DB::TTLTableDescription::getTTLForTableFromAST(std::shared_ptr const&, DB::ColumnsDescription const&, std::shared_ptr, DB::KeyDescription const&) @ 0x00000000336d863a in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/AlterCommands.cpp:613: DB::AlterCommand::apply(DB::StorageInMemoryMetadata&, std::shared_ptr) const @ 0x0000000032be116a in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::AlterCommands::apply(DB::StorageInMemoryMetadata&, std::shared_ptr) const @ 0x0000000032beed7c in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:3145: DB::MergeTreeData::checkAlterIsPossible(DB::AlterCommands const&, std::shared_ptr) const @ 0x0000000033f7cfda in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112ca7a in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 14. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 15. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000311292be in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 21. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:04.369401 [ 3748 ] {1c22aacc-ee92-4c96-915c-22283689e110} executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 3.50 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54946) (comment: 02293_ttest_large_samples.sql) (in query: SELECT roundBankers(result.1, 5), roundBankers(result.2, 5 ) FROM ( SELECT studentTTest(sample, variant) as result FROM ( SELECT toFloat64(number) % 30 AS sample, 0 AS variant FROM system.numbers limit 50000000 UNION ALL SELECT toFloat64(number) % 30 + 0.0022 AS sample, 1 AS variant FROM system.numbers limit 50000000));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:04.748707 [ 3748 ] {1c22aacc-ee92-4c96-915c-22283689e110} TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 3.50 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:04.748769 [ 3737 ] {1a18cfd5-cf10-4bf3-8fdb-f30ef3da29ce} executeQuery: Code: 43. DB::Exception: Illegal type Int32 of argument of function toDayOfMonth. Should be Date, Date32, DateTime or DateTime64: While processing toDayOfMonth(d). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 00933_alter_ttl.sql) (in query: /* ddl_entry=query-0000000010 */ ALTER TABLE test_5.ttl MODIFY COLUMN `d` Int TTL d + toIntervalDay(1)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. DB::IFunctionDateOrDateTime::checkArguments(std::vector> const&, bool) const @ 0x000000001abcf1a3 in /usr/bin/clickhouse 4. DB::FunctionDateOrDateTimeToSomething, DB::ToDayOfMonthImpl>::getReturnTypeImpl(std::vector> const&) const @ 0x000000001abca4b5 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::getActionsDAG(bool, bool) @ 0x000000002fcd0562 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1729: DB::ExpressionAnalyzer::getActions(bool, bool, DB::CompileExpressions) @ 0x000000002fcd13f5 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/KeyDescription.cpp:0: DB::KeyDescription::getSortingKeyFromAST(std::shared_ptr const&, DB::ColumnsDescription const&, std::shared_ptr, std::optional const&) @ 0x0000000032cea541 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/KeyDescription.cpp:75: DB::KeyDescription::recalculateWithNewAST(std::shared_ptr const&, DB::ColumnsDescription const&, std::shared_ptr) @ 0x0000000032ce9418 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/AlterCommands.cpp:949: DB::AlterCommands::apply(DB::StorageInMemoryMetadata&, std::shared_ptr) const @ 0x0000000032beef95 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:3145: DB::MergeTreeData::checkAlterIsPossible(DB::AlterCommands const&, std::shared_ptr) const @ 0x0000000033f7cfda in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112ca7a in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 26. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 27. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000311292be in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:25:04.896629 [ 3737 ] {1a18cfd5-cf10-4bf3-8fdb-f30ef3da29ce} executeQuery: Code: 43. DB::Exception: Illegal type Int32 of argument of function toDayOfMonth. Should be Date, Date32, DateTime or DateTime64: While processing toDayOfMonth(d). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59108) (comment: 00933_alter_ttl.sql) (in query: alter table ttl modify column d Int ttl d + interval 1 day;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. DB::IFunctionDateOrDateTime::checkArguments(std::vector> const&, bool) const @ 0x000000001abcf1a3 in /usr/bin/clickhouse 4. DB::FunctionDateOrDateTimeToSomething, DB::ToDayOfMonthImpl>::getReturnTypeImpl(std::vector> const&) const @ 0x000000001abca4b5 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::getActionsDAG(bool, bool) @ 0x000000002fcd0562 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1729: DB::ExpressionAnalyzer::getActions(bool, bool, DB::CompileExpressions) @ 0x000000002fcd13f5 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/KeyDescription.cpp:0: DB::KeyDescription::getSortingKeyFromAST(std::shared_ptr const&, DB::ColumnsDescription const&, std::shared_ptr, std::optional const&) @ 0x0000000032cea541 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/KeyDescription.cpp:75: DB::KeyDescription::recalculateWithNewAST(std::shared_ptr const&, DB::ColumnsDescription const&, std::shared_ptr) @ 0x0000000032ce9418 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/AlterCommands.cpp:949: DB::AlterCommands::apply(DB::StorageInMemoryMetadata&, std::shared_ptr) const @ 0x0000000032beef95 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:3145: DB::MergeTreeData::checkAlterIsPossible(DB::AlterCommands const&, std::shared_ptr) const @ 0x0000000033f7cfda in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112ca7a in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 26. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 27. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000311292be in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:25:04.898277 [ 3737 ] {1a18cfd5-cf10-4bf3-8fdb-f30ef3da29ce} TCPHandler: Code: 43. DB::Exception: Illegal type Int32 of argument of function toDayOfMonth. Should be Date, Date32, DateTime or DateTime64: While processing toDayOfMonth(d). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. DB::IFunctionDateOrDateTime::checkArguments(std::vector> const&, bool) const @ 0x000000001abcf1a3 in /usr/bin/clickhouse 4. DB::FunctionDateOrDateTimeToSomething, DB::ToDayOfMonthImpl>::getReturnTypeImpl(std::vector> const&) const @ 0x000000001abca4b5 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::getActionsDAG(bool, bool) @ 0x000000002fcd0562 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1729: DB::ExpressionAnalyzer::getActions(bool, bool, DB::CompileExpressions) @ 0x000000002fcd13f5 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/KeyDescription.cpp:0: DB::KeyDescription::getSortingKeyFromAST(std::shared_ptr const&, DB::ColumnsDescription const&, std::shared_ptr, std::optional const&) @ 0x0000000032cea541 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/KeyDescription.cpp:75: DB::KeyDescription::recalculateWithNewAST(std::shared_ptr const&, DB::ColumnsDescription const&, std::shared_ptr) @ 0x0000000032ce9418 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/AlterCommands.cpp:949: DB::AlterCommands::apply(DB::StorageInMemoryMetadata&, std::shared_ptr) const @ 0x0000000032beef95 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:3145: DB::MergeTreeData::checkAlterIsPossible(DB::AlterCommands const&, std::shared_ptr) const @ 0x0000000033f7cfda in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112ca7a in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 26. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 27. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000311292be in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:25:05.391233 [ 3731 ] {3548f16e-1cab-4125-b0ce-684f18068649} executeQuery: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56078) (comment: 01147_partial_merge_full_join.sql) (in query: SELECT * FROM t1 ANY RIGHT JOIN t0 USING (x) ORDER BY x;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:05.646923 [ 3731 ] {3548f16e-1cab-4125-b0ce-684f18068649} TCPHandler: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:05.647192 [ 3737 ] {f3bedffe-ce8e-4839-a283-50578446350e} executeQuery: Code: 524. DB::Exception: ALTER of key column d is forbidden. (ALTER_OF_COLUMN_IS_FORBIDDEN) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 00933_alter_ttl.sql) (in query: /* ddl_entry=query-0000000011 */ ALTER TABLE test_5.ttl MODIFY COLUMN `d` DateTime TTL d + toIntervalDay(1)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:3357: DB::MergeTreeData::checkAlterIsPossible(DB::AlterCommands const&, std::shared_ptr) const @ 0x0000000033f84b97 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112ca7a in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 10. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 11. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000311292be in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:05.692690 [ 3737 ] {f3bedffe-ce8e-4839-a283-50578446350e} executeQuery: Code: 524. DB::Exception: ALTER of key column d is forbidden. (ALTER_OF_COLUMN_IS_FORBIDDEN) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59108) (comment: 00933_alter_ttl.sql) (in query: alter table ttl modify column d DateTime ttl d + interval 1 day;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:3357: DB::MergeTreeData::checkAlterIsPossible(DB::AlterCommands const&, std::shared_ptr) const @ 0x0000000033f84b97 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112ca7a in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 10. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 11. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000311292be in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:05.711394 [ 3737 ] {f3bedffe-ce8e-4839-a283-50578446350e} TCPHandler: Code: 524. DB::Exception: ALTER of key column d is forbidden. (ALTER_OF_COLUMN_IS_FORBIDDEN), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:3357: DB::MergeTreeData::checkAlterIsPossible(DB::AlterCommands const&, std::shared_ptr) const @ 0x0000000033f84b97 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112ca7a in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 10. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 11. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000311292be in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:05.860034 [ 3731 ] {62c7b63d-f627-42bf-a075-c47788f2de03} executeQuery: Code: 48. DB::Exception: ANY FULL JOINs are not implemented. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56078) (comment: 01147_partial_merge_full_join.sql) (in query: SELECT * FROM t1 ANY FULL JOIN t0 USING (x) ORDER BY x;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [35]) @ 0x000000000bdcbb49 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf52d in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:05.885536 [ 3731 ] {62c7b63d-f627-42bf-a075-c47788f2de03} TCPHandler: Code: 48. DB::Exception: ANY FULL JOINs are not implemented. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [35]) @ 0x000000000bdcbb49 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf52d in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:06.947709 [ 1910 ] {cdc3550c-2e1d-4a9e-aac8-29a18248bbf5} executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56218) (comment: 02834_analyzer_with_statement_references.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:06.951782 [ 1910 ] {cdc3550c-2e1d-4a9e-aac8-29a18248bbf5} TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:11.876313 [ 3731 ] {32e201f2-142f-4695-a739-665d403ce98b} executeQuery: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56078) (comment: 01147_partial_merge_full_join.sql) (in query: SELECT * FROM t1 ANY RIGHT JOIN t0 ON t1.x = t0.x ORDER BY x;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:11.879782 [ 3731 ] {32e201f2-142f-4695-a739-665d403ce98b} TCPHandler: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:12.152963 [ 3731 ] {511adad4-2d83-405d-92b4-e0d33819176f} executeQuery: Code: 48. DB::Exception: ANY FULL JOINs are not implemented. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56078) (comment: 01147_partial_merge_full_join.sql) (in query: SELECT * FROM t1 ANY FULL JOIN t0 ON t1.x = t0.x ORDER BY x;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [35]) @ 0x000000000bdcbb49 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf52d in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:12.163421 [ 3731 ] {511adad4-2d83-405d-92b4-e0d33819176f} TCPHandler: Code: 48. DB::Exception: ANY FULL JOINs are not implemented. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [35]) @ 0x000000000bdcbb49 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf52d in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:19.634247 [ 3731 ] {78151610-af64-432c-84e6-f6ba3670d331} executeQuery: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56078) (comment: 01147_partial_merge_full_join.sql) (in query: SELECT * FROM t0 ANY RIGHT JOIN t1 USING (x);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:19.636119 [ 3731 ] {78151610-af64-432c-84e6-f6ba3670d331} TCPHandler: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:19.708984 [ 3731 ] {cca41045-b80a-497f-8d44-a3c90be04b47} executeQuery: Code: 48. DB::Exception: ANY FULL JOINs are not implemented. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56078) (comment: 01147_partial_merge_full_join.sql) (in query: SELECT * FROM t0 ANY FULL JOIN t1 USING (x);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [35]) @ 0x000000000bdcbb49 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf52d in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:19.760842 [ 3731 ] {cca41045-b80a-497f-8d44-a3c90be04b47} TCPHandler: Code: 48. DB::Exception: ANY FULL JOINs are not implemented. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [35]) @ 0x000000000bdcbb49 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf52d in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:22.785279 [ 3731 ] {fe4a4327-5e7b-4e63-abe5-5947cc3774f0} executeQuery: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56078) (comment: 01147_partial_merge_full_join.sql) (in query: SELECT * FROM t0 ANY RIGHT JOIN t1 ON t1.x = t0.x;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:22.789268 [ 3731 ] {fe4a4327-5e7b-4e63-abe5-5947cc3774f0} TCPHandler: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:23.007858 [ 3731 ] {66e38ddc-0f43-4bbc-83ec-4bb880dbcbac} executeQuery: Code: 48. DB::Exception: ANY FULL JOINs are not implemented. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56078) (comment: 01147_partial_merge_full_join.sql) (in query: SELECT * FROM t0 ANY FULL JOIN t1 ON t1.x = t0.x;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [35]) @ 0x000000000bdcbb49 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf52d in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:23.027293 [ 3731 ] {66e38ddc-0f43-4bbc-83ec-4bb880dbcbac} TCPHandler: Code: 48. DB::Exception: ANY FULL JOINs are not implemented. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [35]) @ 0x000000000bdcbb49 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf52d in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:24.656183 [ 2541 ] {0206f256-b6fb-4f7e-b57f-c3ec52f41bce} executeQuery: Code: 201. DB::Exception: Quota for user `u02246` for 3155695200s has been exceeded: query_inserts = 3/2. Interval will end at 2069-12-31 07:00:00. Name of quota template: `q02246`. (QUOTA_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34960) (comment: 02246_async_insert_quota.sh) (in query: INSERT INTO async_inserts_02246 VALUES ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&, String&&, String&&, String&&) @ 0x000000002e14494a in /usr/bin/clickhouse 3. ./build_docker/./src/Access/EnabledQuota.cpp:32: DB::EnabledQuota::Impl::throwQuotaExceed(String const&, String const&, DB::QuotaType, unsigned long, unsigned long, std::chrono::duration>, std::chrono::time_point>>) @ 0x000000002e143e46 in /usr/bin/clickhouse 4. ./build_docker/./src/Access/EnabledQuota.cpp:67: DB::EnabledQuota::Impl::used(String const&, DB::EnabledQuota::Intervals const&, DB::QuotaType, unsigned long, std::chrono::time_point>>, bool) @ 0x000000002e142dfd in /usr/bin/clickhouse 5. ./build_docker/./src/Access/EnabledQuota.cpp:0: DB::EnabledQuota::used(std::pair const&, bool) const @ 0x000000002e13e3c3 in /usr/bin/clickhouse 6. ./build_docker/./src/Access/EnabledQuota.cpp:234: DB::EnabledQuota::used(DB::QuotaType, unsigned long, bool) const @ 0x000000002e13e026 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320ebe15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:24.681118 [ 2541 ] {0206f256-b6fb-4f7e-b57f-c3ec52f41bce} TCPHandler: Code: 201. DB::Exception: Quota for user `u02246` for 3155695200s has been exceeded: query_inserts = 3/2. Interval will end at 2069-12-31 07:00:00. Name of quota template: `q02246`. (QUOTA_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&, String&&, String&&, String&&) @ 0x000000002e14494a in /usr/bin/clickhouse 3. ./build_docker/./src/Access/EnabledQuota.cpp:32: DB::EnabledQuota::Impl::throwQuotaExceed(String const&, String const&, DB::QuotaType, unsigned long, unsigned long, std::chrono::duration>, std::chrono::time_point>>) @ 0x000000002e143e46 in /usr/bin/clickhouse 4. ./build_docker/./src/Access/EnabledQuota.cpp:67: DB::EnabledQuota::Impl::used(String const&, DB::EnabledQuota::Intervals const&, DB::QuotaType, unsigned long, std::chrono::time_point>>, bool) @ 0x000000002e142dfd in /usr/bin/clickhouse 5. ./build_docker/./src/Access/EnabledQuota.cpp:0: DB::EnabledQuota::used(std::pair const&, bool) const @ 0x000000002e13e3c3 in /usr/bin/clickhouse 6. ./build_docker/./src/Access/EnabledQuota.cpp:234: DB::EnabledQuota::used(DB::QuotaType, unsigned long, bool) const @ 0x000000002e13e026 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320ebe15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:29.307419 [ 2479 ] {ac323d79-eeab-4f21-817d-48ec1e068763} executeQuery: Code: 503. DB::Exception: Aggregate function aggThrow has thrown exception successfully: While executing AggregatingTransform. (AGGREGATE_FUNCTION_THROW) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34998) (comment: 02963_msan_agg_addBatchLookupTable8.sql) (in query: -- https://github.com/ClickHouse/ClickHouse/issues/58727 SELECT number % 2 AS even, aggThrow(number) FROM numbers(10) GROUP BY even;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionAggThrow.cpp:71: DB::(anonymous namespace)::AggregateFunctionThrow::create(char*) const @ 0x0000000025f87815 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/Aggregator.cpp:926: void DB::Aggregator::createAggregateStates(char*&) const @ 0x000000002ff5d483 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/Aggregator.cpp:1169: void std::__function::__policy_invoker::__call_impl, FixedHashTableCalculatedSize>, Allocator>, false, false>>(DB::AggregationMethodOneNumber, FixedHashTableCalculatedSize>, Allocator>, false, false>&, DB::AggregationMethodOneNumber, FixedHashTableCalculatedSize>, Allocator>, false, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const::'lambda'(char*&), void (char*&)>>(std::__function::__policy_storage const*, char*&) @ 0x00000000301b73d5 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::IAggregateFunctionDataHelper::addBatchLookupTable8(unsigned long, unsigned long, char**, unsigned long, std::function, char8_t const*, DB::IColumn const**, DB::Arena*) const @ 0x0000000025f889f3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:1160: void DB::Aggregator::executeImplBatch, FixedHashTableCalculatedSize>, Allocator>, false, false>>(DB::AggregationMethodOneNumber, FixedHashTableCalculatedSize>, Allocator>, false, false>&, DB::AggregationMethodOneNumber, FixedHashTableCalculatedSize>, Allocator>, false, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const @ 0x00000000301b5303 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::executeImpl, FixedHashTableCalculatedSize>, Allocator>, false, false>>(DB::AggregationMethodOneNumber, FixedHashTableCalculatedSize>, Allocator>, false, false>&, DB::Arena*, unsigned long, unsigned long, std::vector>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000002ff5d949 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeImpl(DB::AggregatedDataVariants&, unsigned long, unsigned long, std::vector>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000002fda3218 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/Aggregator.cpp:1593: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdabf57 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 17. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:29.315392 [ 2479 ] {ac323d79-eeab-4f21-817d-48ec1e068763} TCPHandler: Code: 503. DB::Exception: Aggregate function aggThrow has thrown exception successfully: While executing AggregatingTransform. (AGGREGATE_FUNCTION_THROW), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionAggThrow.cpp:71: DB::(anonymous namespace)::AggregateFunctionThrow::create(char*) const @ 0x0000000025f87815 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/Aggregator.cpp:926: void DB::Aggregator::createAggregateStates(char*&) const @ 0x000000002ff5d483 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/Aggregator.cpp:1169: void std::__function::__policy_invoker::__call_impl, FixedHashTableCalculatedSize>, Allocator>, false, false>>(DB::AggregationMethodOneNumber, FixedHashTableCalculatedSize>, Allocator>, false, false>&, DB::AggregationMethodOneNumber, FixedHashTableCalculatedSize>, Allocator>, false, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const::'lambda'(char*&), void (char*&)>>(std::__function::__policy_storage const*, char*&) @ 0x00000000301b73d5 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::IAggregateFunctionDataHelper::addBatchLookupTable8(unsigned long, unsigned long, char**, unsigned long, std::function, char8_t const*, DB::IColumn const**, DB::Arena*) const @ 0x0000000025f889f3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:1160: void DB::Aggregator::executeImplBatch, FixedHashTableCalculatedSize>, Allocator>, false, false>>(DB::AggregationMethodOneNumber, FixedHashTableCalculatedSize>, Allocator>, false, false>&, DB::AggregationMethodOneNumber, FixedHashTableCalculatedSize>, Allocator>, false, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const @ 0x00000000301b5303 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::executeImpl, FixedHashTableCalculatedSize>, Allocator>, false, false>>(DB::AggregationMethodOneNumber, FixedHashTableCalculatedSize>, Allocator>, false, false>&, DB::Arena*, unsigned long, unsigned long, std::vector>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000002ff5d949 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeImpl(DB::AggregatedDataVariants&, unsigned long, unsigned long, std::vector>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000002fda3218 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/Aggregator.cpp:1593: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdabf57 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 17. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:30.586187 [ 2541 ] {1df94110-95ec-4d68-9678-a8af32d64ad0} executeQuery: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34966) (comment: 01072_optimize_skip_unused_shards_const_expr_eval.sql) (in query: select * from dist_01072 where key=value;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDistributed.cpp:1329: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&) const @ 0x0000000032dd95b5 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x0000000032dd66dd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e054 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:30.629573 [ 2541 ] {1df94110-95ec-4d68-9678-a8af32d64ad0} TCPHandler: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDistributed.cpp:1329: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&) const @ 0x0000000032dd95b5 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x0000000032dd66dd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e054 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:30.710632 [ 2541 ] {dfcec9e3-0924-4249-868c-56902cb38c63} executeQuery: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34966) (comment: 01072_optimize_skip_unused_shards_const_expr_eval.sql) (in query: select * from dist_01072 where key=toInt32(value);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDistributed.cpp:1329: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&) const @ 0x0000000032dd95b5 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x0000000032dd66dd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e054 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:30.712572 [ 2541 ] {dfcec9e3-0924-4249-868c-56902cb38c63} TCPHandler: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDistributed.cpp:1329: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&) const @ 0x0000000032dd95b5 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x0000000032dd66dd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e054 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:30.956724 [ 3731 ] {7cd1740e-ad51-4928-8364-f0466abdc64c} executeQuery: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56078) (comment: 01147_partial_merge_full_join.sql) (in query: SELECT * FROM t1 ANY RIGHT JOIN t0 USING (x) ORDER BY x;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:30.969398 [ 3731 ] {7cd1740e-ad51-4928-8364-f0466abdc64c} TCPHandler: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:31.049722 [ 3731 ] {7dfdecd7-a923-4343-b717-c925af2cc239} executeQuery: Code: 48. DB::Exception: ANY FULL JOINs are not implemented. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56078) (comment: 01147_partial_merge_full_join.sql) (in query: SELECT * FROM t1 ANY FULL JOIN t0 USING (x) ORDER BY x;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [35]) @ 0x000000000bdcbb49 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf52d in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:31.054634 [ 3731 ] {7dfdecd7-a923-4343-b717-c925af2cc239} TCPHandler: Code: 48. DB::Exception: ANY FULL JOINs are not implemented. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [35]) @ 0x000000000bdcbb49 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf52d in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:32.349949 [ 2541 ] {e39ffa92-f59b-410c-b3d6-8a3b7493c4cc} executeQuery: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34966) (comment: 01072_optimize_skip_unused_shards_const_expr_eval.sql) (in query: select * from dist_01072 where key=value;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDistributed.cpp:1329: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&) const @ 0x0000000032dd95b5 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x0000000032dd66dd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e054 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:32.380016 [ 2541 ] {e39ffa92-f59b-410c-b3d6-8a3b7493c4cc} TCPHandler: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDistributed.cpp:1329: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&) const @ 0x0000000032dd95b5 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x0000000032dd66dd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e054 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:32.595025 [ 2541 ] {d2aee837-00e5-4eeb-ae66-033bd8287832} executeQuery: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34966) (comment: 01072_optimize_skip_unused_shards_const_expr_eval.sql) (in query: select * from dist_01072 where key=toInt32(value);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDistributed.cpp:1329: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&) const @ 0x0000000032dd95b5 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x0000000032dd66dd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e054 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:32.605450 [ 2541 ] {d2aee837-00e5-4eeb-ae66-033bd8287832} TCPHandler: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDistributed.cpp:1329: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&) const @ 0x0000000032dd95b5 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x0000000032dd66dd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e054 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:33.420839 [ 2541 ] {a4f689b5-ac3e-4943-a0d4-a93ca95194b8} executeQuery: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34966) (comment: 01072_optimize_skip_unused_shards_const_expr_eval.sql) (in query: select * from dist_01072 where key=value;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDistributed.cpp:1329: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&) const @ 0x0000000032dd95b5 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x0000000032dd66dd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e054 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:33.426729 [ 2541 ] {a4f689b5-ac3e-4943-a0d4-a93ca95194b8} TCPHandler: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDistributed.cpp:1329: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&) const @ 0x0000000032dd95b5 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x0000000032dd66dd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e054 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:33.523318 [ 2541 ] {60971c58-a4e9-47ed-ab3e-99288a4fbc5d} executeQuery: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34966) (comment: 01072_optimize_skip_unused_shards_const_expr_eval.sql) (in query: select * from dist_01072 where key=toInt32(value);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDistributed.cpp:1329: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&) const @ 0x0000000032dd95b5 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x0000000032dd66dd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e054 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:33.540505 [ 2541 ] {60971c58-a4e9-47ed-ab3e-99288a4fbc5d} TCPHandler: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDistributed.cpp:1329: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&) const @ 0x0000000032dd95b5 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x0000000032dd66dd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e054 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:34.199856 [ 2541 ] {60fa7ac2-30e3-4d10-a7a5-f426b2755334} executeQuery: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34966) (comment: 01072_optimize_skip_unused_shards_const_expr_eval.sql) (in query: select * from dist_01072 where key=value;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDistributed.cpp:1329: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&) const @ 0x0000000032dd95b5 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x0000000032dd66dd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e054 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:34.305571 [ 2541 ] {60fa7ac2-30e3-4d10-a7a5-f426b2755334} TCPHandler: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDistributed.cpp:1329: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&) const @ 0x0000000032dd95b5 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x0000000032dd66dd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e054 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:34.624030 [ 2541 ] {db068c84-418f-42a9-92f4-20a581ac2f55} executeQuery: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34966) (comment: 01072_optimize_skip_unused_shards_const_expr_eval.sql) (in query: select * from dist_01072 where key=toInt32(value);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDistributed.cpp:1329: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&) const @ 0x0000000032dd95b5 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x0000000032dd66dd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e054 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:34.637683 [ 2541 ] {db068c84-418f-42a9-92f4-20a581ac2f55} TCPHandler: Code: 507. DB::Exception: Sharding key modulo(key, 2) is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageDistributed.cpp:1329: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&) const @ 0x0000000032dd95b5 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageDistributed.cpp:0: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x0000000032dd66dd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:926: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e054 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:34.888758 [ 3749 ] {27ef2e56-05bb-4aaf-8484-903a554391b8} executeQuery: Code: 44. DB::Exception: Sorting key contains nullable columns, but merge tree setting `allow_nullable_key` is disabled. (ILLEGAL_COLUMN) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49532) (comment: 02920_alter_column_of_projections.sql) (in query: CREATE TABLE t (`uid` Int16, `name` String, `age` Nullable(Int8), `i` Int16, `j` Int16, PROJECTION p1 (SELECT name, age, uniq(i), count(j) GROUP BY name, age)) ENGINE = MergeTree ORDER BY uid SETTINGS index_granularity = 1, min_bytes_for_wide_part = 63961362, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 18260, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 688754, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 409103469, index_granularity_bytes = 6429999, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 68794, primary_key_compress_block_size = 40451), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:477: DB::checkKeyExpression(DB::ExpressionActions const&, DB::Block const&, String const&, bool) @ 0x0000000033f06098 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::MergeTreeData::checkProperties(DB::StorageInMemoryMetadata const&, DB::StorageInMemoryMetadata const&, bool, bool, std::shared_ptr) const @ 0x0000000033f0302b in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:606: DB::MergeTreeData::checkProperties(DB::StorageInMemoryMetadata const&, DB::StorageInMemoryMetadata const&, bool, bool, std::shared_ptr) const @ 0x0000000033f02db4 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:620: DB::MergeTreeData::MergeTreeData(DB::StorageID const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, bool, std::function) @ 0x0000000033ef7aed in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageMergeTree.cpp:101: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa3cf in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:34.895488 [ 3749 ] {27ef2e56-05bb-4aaf-8484-903a554391b8} TCPHandler: Code: 44. DB::Exception: Sorting key contains nullable columns, but merge tree setting `allow_nullable_key` is disabled. (ILLEGAL_COLUMN), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:477: DB::checkKeyExpression(DB::ExpressionActions const&, DB::Block const&, String const&, bool) @ 0x0000000033f06098 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::MergeTreeData::checkProperties(DB::StorageInMemoryMetadata const&, DB::StorageInMemoryMetadata const&, bool, bool, std::shared_ptr) const @ 0x0000000033f0302b in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:606: DB::MergeTreeData::checkProperties(DB::StorageInMemoryMetadata const&, DB::StorageInMemoryMetadata const&, bool, bool, std::shared_ptr) const @ 0x0000000033f02db4 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:620: DB::MergeTreeData::MergeTreeData(DB::StorageID const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, bool, std::function) @ 0x0000000033ef7aed in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageMergeTree.cpp:101: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa3cf in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:35.003948 [ 3731 ] {851c482f-b3d2-44e4-a99f-40abd6f0d86d} executeQuery: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56078) (comment: 01147_partial_merge_full_join.sql) (in query: SELECT * FROM t1 ANY RIGHT JOIN t0 ON t1.x = t0.x ORDER BY x;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:35.007702 [ 3731 ] {851c482f-b3d2-44e4-a99f-40abd6f0d86d} TCPHandler: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:35.131686 [ 3731 ] {0e565d9c-1883-470d-984f-1e3429caaff7} executeQuery: Code: 48. DB::Exception: ANY FULL JOINs are not implemented. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56078) (comment: 01147_partial_merge_full_join.sql) (in query: SELECT * FROM t1 ANY FULL JOIN t0 ON t1.x = t0.x ORDER BY x;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [35]) @ 0x000000000bdcbb49 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf52d in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:35.135449 [ 3731 ] {0e565d9c-1883-470d-984f-1e3429caaff7} TCPHandler: Code: 48. DB::Exception: ANY FULL JOINs are not implemented. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [35]) @ 0x000000000bdcbb49 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf52d in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:36.504132 [ 3731 ] {e00c73f0-bc46-4561-828d-c131c0c25b77} executeQuery: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56078) (comment: 01147_partial_merge_full_join.sql) (in query: SELECT * FROM t0 ANY RIGHT JOIN t1 USING (x);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:36.529524 [ 3731 ] {e00c73f0-bc46-4561-828d-c131c0c25b77} TCPHandler: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:36.699180 [ 3731 ] {82da5a02-0739-45fb-a710-c5b5e43b4aa6} executeQuery: Code: 48. DB::Exception: ANY FULL JOINs are not implemented. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56078) (comment: 01147_partial_merge_full_join.sql) (in query: SELECT * FROM t0 ANY FULL JOIN t1 USING (x);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [35]) @ 0x000000000bdcbb49 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf52d in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:36.704041 [ 3731 ] {82da5a02-0739-45fb-a710-c5b5e43b4aa6} TCPHandler: Code: 48. DB::Exception: ANY FULL JOINs are not implemented. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [35]) @ 0x000000000bdcbb49 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf52d in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:38.239735 [ 3731 ] {a50a5854-0503-4f06-a5a2-e40a53113f77} executeQuery: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56078) (comment: 01147_partial_merge_full_join.sql) (in query: SELECT * FROM t0 ANY RIGHT JOIN t1 ON t1.x = t0.x;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:38.248707 [ 3731 ] {a50a5854-0503-4f06-a5a2-e40a53113f77} TCPHandler: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:38.369426 [ 3731 ] {2eb873aa-9931-4157-baaa-bca84c1a784a} executeQuery: Code: 48. DB::Exception: ANY FULL JOINs are not implemented. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56078) (comment: 01147_partial_merge_full_join.sql) (in query: SELECT * FROM t0 ANY FULL JOIN t1 ON t1.x = t0.x;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [35]) @ 0x000000000bdcbb49 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf52d in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:38.373328 [ 3731 ] {2eb873aa-9931-4157-baaa-bca84c1a784a} TCPHandler: Code: 48. DB::Exception: ANY FULL JOINs are not implemented. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [35]) @ 0x000000000bdcbb49 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edf52d in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:43.400833 [ 3740 ] {bda6da36-d03f-4644-88e5-16bf28fba352} executeQuery: Code: 69. DB::Exception: Length of the pattern argument in function replaceAll must be greater than 0.: while executing 'FUNCTION replaceAll(haystack :: 0, needle :: 1, 'x' :: 2) -> replaceAll(haystack, needle, 'x') String : 3'. (ARGUMENT_OUT_OF_BOUND) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34946) (comment: 02536_replace_with_nonconst_needle_and_replacement.sql) (in query: -- needle: non-const, replacement: const SELECT replaceAll(haystack, needle, 'x') FROM test_tab;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceAll>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7adf2f in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:43.412022 [ 3740 ] {bda6da36-d03f-4644-88e5-16bf28fba352} TCPHandler: Code: 69. DB::Exception: Length of the pattern argument in function replaceAll must be greater than 0.: while executing 'FUNCTION replaceAll(haystack :: 0, needle :: 1, 'x' :: 2) -> replaceAll(haystack, needle, 'x') String : 3'. (ARGUMENT_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceAll>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7adf2f in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:43.719339 [ 3747 ] {7159ca2b-900d-4a9c-8e97-83072eb7d66e} executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 76.17 MiB (attempt to allocate chunk of 1049088 bytes), maximum: 9.31 GiB: while executing 'FUNCTION array(hex(v) : 4, hex(v) :: 4) -> array(hex(v), hex(v)) Array(String) : 3'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 00377_shard_group_uniq_array_of_string_array.sql) (in query: /* ddl_entry=query-0000000020 */ CREATE TABLE test_11.group_uniq_arr_str UUID '9d7ee015-05ca-4e98-b162-7d937f08a6fa' (`id` String, `v` Array(String)) ENGINE = Memory AS SELECT hex(intHash32(g)) AS id, if(c = 0, [hex(v)], if(c = 1, emptyArrayString(), [hex(v), hex(v)])) AS v FROM (SELECT intDiv(number % 1000000, 100) AS v, intDiv(number % 100, 10) AS g, number % 10 AS c FROM system.numbers WHERE c < 3 LIMIT 10000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 7. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/memcpySmall.h:40: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x00000000326f2a83 in /usr/bin/clickhouse 9. DB::FunctionArray::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001b2bc5dd in /usr/bin/clickhouse 10. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e9b1 in /usr/bin/clickhouse 13. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:111: DB::CompletedPipelineExecutor::execute() @ 0x0000000034ff9b73 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1421: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320fa883 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 26. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 27. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:25:43.735365 [ 3740 ] {055de7e6-4277-4e33-83be-db0437147cd7} executeQuery: Code: 69. DB::Exception: Length of the pattern argument in function replaceOne must be greater than 0.: while executing 'FUNCTION replaceOne(haystack :: 0, needle :: 1, 'x' :: 2) -> replaceOne(haystack, needle, 'x') String : 3'. (ARGUMENT_OUT_OF_BOUND) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34946) (comment: 02536_replace_with_nonconst_needle_and_replacement.sql) (in query: SELECT replaceOne(haystack, needle, 'x') FROM test_tab;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceOne>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7b774e in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:43.756603 [ 3740 ] {055de7e6-4277-4e33-83be-db0437147cd7} TCPHandler: Code: 69. DB::Exception: Length of the pattern argument in function replaceOne must be greater than 0.: while executing 'FUNCTION replaceOne(haystack :: 0, needle :: 1, 'x' :: 2) -> replaceOne(haystack, needle, 'x') String : 3'. (ARGUMENT_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceOne>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7b774e in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:43.960037 [ 3747 ] {7159ca2b-900d-4a9c-8e97-83072eb7d66e} executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 76.17 MiB (attempt to allocate chunk of 1049088 bytes), maximum: 9.31 GiB: while executing 'FUNCTION array(hex(v) : 4, hex(v) :: 4) -> array(hex(v), hex(v)) Array(String) : 3'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49612) (comment: 00377_shard_group_uniq_array_of_string_array.sql) (in query: CREATE TABLE group_uniq_arr_str ENGINE = Memory AS SELECT hex(intHash32(g)) as id, if(c == 0, [hex(v)], if(c == 1, emptyArrayString(), [hex(v), hex(v)])) as v FROM (SELECT intDiv(number%1000000, 100) as v, intDiv(number%100, 10) as g, number%10 as c FROM system.numbers WHERE c < 3 LIMIT 10000000);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 7. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/memcpySmall.h:40: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x00000000326f2a83 in /usr/bin/clickhouse 9. DB::FunctionArray::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001b2bc5dd in /usr/bin/clickhouse 10. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e9b1 in /usr/bin/clickhouse 13. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:111: DB::CompletedPipelineExecutor::execute() @ 0x0000000034ff9b73 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1421: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320fa883 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 26. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 27. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:25:43.968592 [ 3747 ] {7159ca2b-900d-4a9c-8e97-83072eb7d66e} TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 76.17 MiB (attempt to allocate chunk of 1049088 bytes), maximum: 9.31 GiB: while executing 'FUNCTION array(hex(v) : 4, hex(v) :: 4) -> array(hex(v), hex(v)) Array(String) : 3'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 7. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/memcpySmall.h:40: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x00000000326f2a83 in /usr/bin/clickhouse 9. DB::FunctionArray::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001b2bc5dd in /usr/bin/clickhouse 10. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e9b1 in /usr/bin/clickhouse 13. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:111: DB::CompletedPipelineExecutor::execute() @ 0x0000000034ff9b73 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1421: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320fa883 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 26. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 27. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:25:44.277697 [ 3740 ] {b5030544-ce81-4332-b054-72cc2e3524cc} executeQuery: Code: 69. DB::Exception: Length of the pattern argument in function replaceRegexpAll must be greater than 0.: while executing 'FUNCTION replaceRegexpAll(haystack :: 0, needle :: 1, 'x' :: 2) -> replaceRegexpAll(haystack, needle, 'x') String : 3'. (ARGUMENT_OUT_OF_BOUND) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34946) (comment: 02536_replace_with_nonconst_needle_and_replacement.sql) (in query: SELECT replaceRegexpAll(haystack, needle, 'x') FROM test_tab;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceRegexpAll>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7c0bed in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:44.279718 [ 3740 ] {b5030544-ce81-4332-b054-72cc2e3524cc} TCPHandler: Code: 69. DB::Exception: Length of the pattern argument in function replaceRegexpAll must be greater than 0.: while executing 'FUNCTION replaceRegexpAll(haystack :: 0, needle :: 1, 'x' :: 2) -> replaceRegexpAll(haystack, needle, 'x') String : 3'. (ARGUMENT_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceRegexpAll>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7c0bed in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:44.636186 [ 3740 ] {4b18c4de-492a-4ea6-b45f-b69467a55777} executeQuery: Code: 69. DB::Exception: Length of the pattern argument in function replaceRegexpOne must be greater than 0.: while executing 'FUNCTION replaceRegexpOne(haystack :: 0, needle :: 1, 'x' :: 2) -> replaceRegexpOne(haystack, needle, 'x') String : 3'. (ARGUMENT_OUT_OF_BOUND) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34946) (comment: 02536_replace_with_nonconst_needle_and_replacement.sql) (in query: SELECT replaceRegexpOne(haystack, needle, 'x') FROM test_tab;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceRegexpOne>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7cd24d in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:44.673265 [ 3740 ] {4b18c4de-492a-4ea6-b45f-b69467a55777} TCPHandler: Code: 69. DB::Exception: Length of the pattern argument in function replaceRegexpOne must be greater than 0.: while executing 'FUNCTION replaceRegexpOne(haystack :: 0, needle :: 1, 'x' :: 2) -> replaceRegexpOne(haystack, needle, 'x') String : 3'. (ARGUMENT_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceRegexpOne>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7cd24d in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:44.959465 [ 3740 ] {f560c210-7091-4fc0-afcd-3b3cfbcbd175} executeQuery: Code: 69. DB::Exception: Length of the pattern argument in function replaceAll must be greater than 0. (ARGUMENT_OUT_OF_BOUND) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34946) (comment: 02536_replace_with_nonconst_needle_and_replacement.sql) (in query: -- needle: const, replacement: non-const SELECT replaceAll(haystack, '', replacement) FROM test_tab;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceAll>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7ae5b5 in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::updateHeader(DB::Block) const @ 0x000000002f6ae739 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transformHeader(DB::Block, DB::ActionsDAG const&) @ 0x00000000357c2c3b in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/QueryPlan/ExpressionStep.cpp:0: DB::ExpressionStep::ExpressionStep(DB::DataStream const&, std::shared_ptr const&) @ 0x0000000035c10a89 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeExpression(DB::QueryPlan&, std::shared_ptr const&, String const&) @ 0x00000000315421eb in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031528708 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:45.012443 [ 3740 ] {f560c210-7091-4fc0-afcd-3b3cfbcbd175} TCPHandler: Code: 69. DB::Exception: Length of the pattern argument in function replaceAll must be greater than 0. (ARGUMENT_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceAll>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7ae5b5 in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::updateHeader(DB::Block) const @ 0x000000002f6ae739 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transformHeader(DB::Block, DB::ActionsDAG const&) @ 0x00000000357c2c3b in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/QueryPlan/ExpressionStep.cpp:0: DB::ExpressionStep::ExpressionStep(DB::DataStream const&, std::shared_ptr const&) @ 0x0000000035c10a89 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeExpression(DB::QueryPlan&, std::shared_ptr const&, String const&) @ 0x00000000315421eb in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031528708 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:45.517567 [ 3740 ] {7f013b31-55aa-44ab-810f-5a0a23914712} executeQuery: Code: 69. DB::Exception: Length of the pattern argument in function replaceOne must be greater than 0. (ARGUMENT_OUT_OF_BOUND) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34946) (comment: 02536_replace_with_nonconst_needle_and_replacement.sql) (in query: SELECT replaceOne(haystack, '', replacement) FROM test_tab;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceOne>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7b7cb7 in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::updateHeader(DB::Block) const @ 0x000000002f6ae739 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transformHeader(DB::Block, DB::ActionsDAG const&) @ 0x00000000357c2c3b in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/QueryPlan/ExpressionStep.cpp:0: DB::ExpressionStep::ExpressionStep(DB::DataStream const&, std::shared_ptr const&) @ 0x0000000035c10a89 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeExpression(DB::QueryPlan&, std::shared_ptr const&, String const&) @ 0x00000000315421eb in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031528708 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:45.522290 [ 3740 ] {7f013b31-55aa-44ab-810f-5a0a23914712} TCPHandler: Code: 69. DB::Exception: Length of the pattern argument in function replaceOne must be greater than 0. (ARGUMENT_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceOne>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7b7cb7 in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::updateHeader(DB::Block) const @ 0x000000002f6ae739 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transformHeader(DB::Block, DB::ActionsDAG const&) @ 0x00000000357c2c3b in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/QueryPlan/ExpressionStep.cpp:0: DB::ExpressionStep::ExpressionStep(DB::DataStream const&, std::shared_ptr const&) @ 0x0000000035c10a89 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeExpression(DB::QueryPlan&, std::shared_ptr const&, String const&) @ 0x00000000315421eb in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031528708 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:45.962859 [ 3740 ] {d36d1561-2046-4ae5-a5ea-45a6498ae422} executeQuery: Code: 69. DB::Exception: Length of the pattern argument in function replaceRegexpAll must be greater than 0. (ARGUMENT_OUT_OF_BOUND) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34946) (comment: 02536_replace_with_nonconst_needle_and_replacement.sql) (in query: SELECT replaceRegexpAll(haystack, '', replacement) FROM test_tab;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceRegexpAll>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7c1604 in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::updateHeader(DB::Block) const @ 0x000000002f6ae739 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transformHeader(DB::Block, DB::ActionsDAG const&) @ 0x00000000357c2c3b in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/QueryPlan/ExpressionStep.cpp:0: DB::ExpressionStep::ExpressionStep(DB::DataStream const&, std::shared_ptr const&) @ 0x0000000035c10a89 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeExpression(DB::QueryPlan&, std::shared_ptr const&, String const&) @ 0x00000000315421eb in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031528708 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:45.971233 [ 3740 ] {d36d1561-2046-4ae5-a5ea-45a6498ae422} TCPHandler: Code: 69. DB::Exception: Length of the pattern argument in function replaceRegexpAll must be greater than 0. (ARGUMENT_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceRegexpAll>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7c1604 in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::updateHeader(DB::Block) const @ 0x000000002f6ae739 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transformHeader(DB::Block, DB::ActionsDAG const&) @ 0x00000000357c2c3b in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/QueryPlan/ExpressionStep.cpp:0: DB::ExpressionStep::ExpressionStep(DB::DataStream const&, std::shared_ptr const&) @ 0x0000000035c10a89 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeExpression(DB::QueryPlan&, std::shared_ptr const&, String const&) @ 0x00000000315421eb in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031528708 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:46.345941 [ 3740 ] {d110aa02-e110-4b82-af10-2acf69238ad8} executeQuery: Code: 69. DB::Exception: Length of the pattern argument in function replaceRegexpOne must be greater than 0. (ARGUMENT_OUT_OF_BOUND) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34946) (comment: 02536_replace_with_nonconst_needle_and_replacement.sql) (in query: SELECT replaceRegexpOne(haystack, '', replacement) FROM test_tab;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceRegexpOne>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7cdc64 in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::updateHeader(DB::Block) const @ 0x000000002f6ae739 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transformHeader(DB::Block, DB::ActionsDAG const&) @ 0x00000000357c2c3b in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/QueryPlan/ExpressionStep.cpp:0: DB::ExpressionStep::ExpressionStep(DB::DataStream const&, std::shared_ptr const&) @ 0x0000000035c10a89 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeExpression(DB::QueryPlan&, std::shared_ptr const&, String const&) @ 0x00000000315421eb in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031528708 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:46.360225 [ 3740 ] {d110aa02-e110-4b82-af10-2acf69238ad8} TCPHandler: Code: 69. DB::Exception: Length of the pattern argument in function replaceRegexpOne must be greater than 0. (ARGUMENT_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceRegexpOne>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7cdc64 in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::updateHeader(DB::Block) const @ 0x000000002f6ae739 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transformHeader(DB::Block, DB::ActionsDAG const&) @ 0x00000000357c2c3b in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/QueryPlan/ExpressionStep.cpp:0: DB::ExpressionStep::ExpressionStep(DB::DataStream const&, std::shared_ptr const&) @ 0x0000000035c10a89 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeExpression(DB::QueryPlan&, std::shared_ptr const&, String const&) @ 0x00000000315421eb in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031528708 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:46.683306 [ 3740 ] {852764b4-320a-4233-86c8-69b4e3e48ec2} executeQuery: Code: 69. DB::Exception: Length of the pattern argument in function replaceAll must be greater than 0.: while executing 'FUNCTION replaceAll(haystack :: 0, needle :: 1, replacement :: 2) -> replaceAll(haystack, needle, replacement) String : 3'. (ARGUMENT_OUT_OF_BOUND) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34946) (comment: 02536_replace_with_nonconst_needle_and_replacement.sql) (in query: -- needle: non-const, replacement: non-const SELECT replaceAll(haystack, needle, replacement) FROM test_tab;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceAll>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7ae20d in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:46.809296 [ 3740 ] {852764b4-320a-4233-86c8-69b4e3e48ec2} TCPHandler: Code: 69. DB::Exception: Length of the pattern argument in function replaceAll must be greater than 0.: while executing 'FUNCTION replaceAll(haystack :: 0, needle :: 1, replacement :: 2) -> replaceAll(haystack, needle, replacement) String : 3'. (ARGUMENT_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceAll>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7ae20d in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:46.809437 [ 2801 ] {80fa25f7-7786-4439-bc1c-828d4e190ddb} executeQuery: Code: 210. DB::Exception: Unable to connect to HDFS: Hdfs::HdfsRpcException: HdfsFailoverException: Failed to invoke RPC call "getFsStats" on server "localhost:12222" Caused by: HdfsNetworkConnectException: Connect to "localhost:12222" failed: (errno: 111) Connection refused. (NETWORK_ERROR) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59072) (comment: 02725_database_hdfs.sh) (in query: insert into table function hdfs('hdfs://localhost:12222/test_02725_1.tsv', 'TSV', 'column1 UInt32, column2 UInt32, column3 UInt32') select 1, 2, 3 settings hdfs_truncate_on_insert=1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/HDFS/HDFSCommon.cpp:176: DB::createHDFSFS(hdfsBuilder*) @ 0x000000002ddbade6 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/HDFS/StorageHDFS.cpp:0: DB::StorageHDFS::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002dd89a35 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Transforms/buildPushingToViewsChain.cpp:0: DB::buildPushingToViewsChain(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, bool, std::shared_ptr, std::shared_ptr, std::atomic*, bool, DB::Block const&) @ 0x000000003597e761 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:291: DB::InterpreterInsertQuery::buildSink(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::atomic*) @ 0x00000000314a79c7 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:534: DB::InterpreterInsertQuery::execute() @ 0x00000000314afcbd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:46.823053 [ 2801 ] {80fa25f7-7786-4439-bc1c-828d4e190ddb} TCPHandler: Code: 210. DB::Exception: Unable to connect to HDFS: Hdfs::HdfsRpcException: HdfsFailoverException: Failed to invoke RPC call "getFsStats" on server "localhost:12222" Caused by: HdfsNetworkConnectException: Connect to "localhost:12222" failed: (errno: 111) Connection refused. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/HDFS/HDFSCommon.cpp:176: DB::createHDFSFS(hdfsBuilder*) @ 0x000000002ddbade6 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/HDFS/StorageHDFS.cpp:0: DB::StorageHDFS::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002dd89a35 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Transforms/buildPushingToViewsChain.cpp:0: DB::buildPushingToViewsChain(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, bool, std::shared_ptr, std::shared_ptr, std::atomic*, bool, DB::Block const&) @ 0x000000003597e761 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:291: DB::InterpreterInsertQuery::buildSink(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::atomic*) @ 0x00000000314a79c7 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:534: DB::InterpreterInsertQuery::execute() @ 0x00000000314afcbd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:47.354309 [ 3740 ] {78634768-a27c-4bb7-bca3-45db353c0709} executeQuery: Code: 69. DB::Exception: Length of the pattern argument in function replaceOne must be greater than 0.: while executing 'FUNCTION replaceOne(haystack :: 0, needle :: 1, replacement :: 2) -> replaceOne(haystack, needle, replacement) String : 3'. (ARGUMENT_OUT_OF_BOUND) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34946) (comment: 02536_replace_with_nonconst_needle_and_replacement.sql) (in query: SELECT replaceOne(haystack, needle, replacement) FROM test_tab;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceOne>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7b790d in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:47.407076 [ 3740 ] {78634768-a27c-4bb7-bca3-45db353c0709} TCPHandler: Code: 69. DB::Exception: Length of the pattern argument in function replaceOne must be greater than 0.: while executing 'FUNCTION replaceOne(haystack :: 0, needle :: 1, replacement :: 2) -> replaceOne(haystack, needle, replacement) String : 3'. (ARGUMENT_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceOne>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7b790d in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:47.747740 [ 3740 ] {abcd5816-92f9-4999-b0a2-748e962bf4d2} executeQuery: Code: 69. DB::Exception: Length of the pattern argument in function replaceRegexpAll must be greater than 0.: while executing 'FUNCTION replaceRegexpAll(haystack :: 0, needle :: 1, replacement :: 2) -> replaceRegexpAll(haystack, needle, replacement) String : 3'. (ARGUMENT_OUT_OF_BOUND) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34946) (comment: 02536_replace_with_nonconst_needle_and_replacement.sql) (in query: SELECT replaceRegexpAll(haystack, needle, replacement) FROM test_tab;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceRegexpAll>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7c104d in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:47.756136 [ 3740 ] {abcd5816-92f9-4999-b0a2-748e962bf4d2} TCPHandler: Code: 69. DB::Exception: Length of the pattern argument in function replaceRegexpAll must be greater than 0.: while executing 'FUNCTION replaceRegexpAll(haystack :: 0, needle :: 1, replacement :: 2) -> replaceRegexpAll(haystack, needle, replacement) String : 3'. (ARGUMENT_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceRegexpAll>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7c104d in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:47.935310 [ 3740 ] {e700f225-fe39-45b1-814c-baed07b75f4b} executeQuery: Code: 69. DB::Exception: Length of the pattern argument in function replaceRegexpOne must be greater than 0.: while executing 'FUNCTION replaceRegexpOne(haystack :: 0, needle :: 1, replacement :: 2) -> replaceRegexpOne(haystack, needle, replacement) String : 3'. (ARGUMENT_OUT_OF_BOUND) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34946) (comment: 02536_replace_with_nonconst_needle_and_replacement.sql) (in query: SELECT replaceRegexpOne(haystack, needle, replacement) FROM test_tab;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceRegexpOne>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7cd6ad in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:48.072962 [ 2653 ] {9c2870af-a10d-4c2a-bdde-a44cf6d7c4ef} DynamicQueryHandler: Code: 271. DB::Exception: Cannot decompress Gorilla-encoded data. File has wrong header. (CANNOT_DECOMPRESS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [62]) @ 0x000000000d366ea9 in /usr/bin/clickhouse 3. ./build_docker/./src/Compression/CompressionCodecGorilla.cpp:0: DB::CompressionCodecGorilla::doDecompressData(char const*, unsigned int, char*, unsigned int) const @ 0x000000002ed0d6b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Compression/ICompressionCodec.cpp:113: DB::ICompressionCodec::decompress(char const*, unsigned int, char*) const @ 0x000000002ed28447 in /usr/bin/clickhouse 5. ./build_docker/./src/Compression/CompressedReadBufferBase.cpp:0: DB::CompressedReadBufferBase::decompress(DB::BufferBase::Buffer&, unsigned long, unsigned long) @ 0x000000002ec75cde in /usr/bin/clickhouse 6. ./build_docker/./src/Compression/CompressedReadBuffer.cpp:0: non-virtual thunk to DB::CompressedReadBuffer::nextImpl() @ 0x000000002ec70806 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/ReadBuffer.h:71: DB::(anonymous namespace)::ReadBufferWrapper::nextImpl() @ 0x000000002e5ce25b in /usr/bin/clickhouse 8. ./build_docker/./src/IO/ReadBuffer.h:72: DB::ConcatReadBuffer::nextImpl() @ 0x000000002f8bdd63 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/ReadBuffer.h:72: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f7610 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 11. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:25:48.072978 [ 3740 ] {e700f225-fe39-45b1-814c-baed07b75f4b} TCPHandler: Code: 69. DB::Exception: Length of the pattern argument in function replaceRegexpOne must be greater than 0.: while executing 'FUNCTION replaceRegexpOne(haystack :: 0, needle :: 1, replacement :: 2) -> replaceRegexpOne(haystack, needle, replacement) String : 3'. (ARGUMENT_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000be137c7 in /usr/bin/clickhouse 3. DB::FunctionStringReplace, DB::(anonymous namespace)::NameReplaceRegexpOne>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7cd6ad in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:50.274065 [ 3746 ] {6869bd07-9e98-4524-8746-03f2a3f5449b} executeQuery: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type: While processing SELECT a, b FROM (SELECT 1 AS a) ANY LEFT JOIN (SELECT 1 AS a, 1 AS b) USING (a) WHERE b = 0. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:48098) (comment: 00597_push_down_predicate_long.sql) (in query: -- LEFT JOIN EXPLAIN SYNTAX SELECT a, b FROM (SELECT 1 AS a) ANY LEFT JOIN (SELECT 1 AS a, 1 AS b) USING (a) WHERE b = 0;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:356: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x0000000031501c53 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:198: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000315013b7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::InDepthNodeVisitor>::doVisit(std::shared_ptr&) @ 0x000000003119f6a7 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x00000000311a0496 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x00000000311a04a1 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x00000000311a04a1 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::InterpreterExplainQuery::executeImpl() @ 0x000000003117d2ae in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterExplainQuery.cpp:0: DB::InterpreterExplainQuery::execute() @ 0x00000000311787bf in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:50.286530 [ 3746 ] {6869bd07-9e98-4524-8746-03f2a3f5449b} TCPHandler: Code: 48. DB::Exception: Can't execute PARTIAL_MERGE join algorithm for this strictness/kind and right storage type: While processing SELECT a, b FROM (SELECT 1 AS a) ANY LEFT JOIN (SELECT 1 AS a, 1 AS b) USING (a) WHERE b = 0. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, std::__wrap_iter, char>>(int, FormatStringHelperImpl, std::__wrap_iter, char>>::type>, fmt::v8::join_view, std::__wrap_iter, char>&&) @ 0x000000002fcf15bb in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:1012: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000002fcbb953 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000002fcb4bc9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd5075 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:356: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x0000000031501c53 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:198: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000315013b7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::InDepthNodeVisitor>::doVisit(std::shared_ptr&) @ 0x000000003119f6a7 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x00000000311a0496 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x00000000311a04a1 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x00000000311a04a1 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: DB::InterpreterExplainQuery::executeImpl() @ 0x000000003117d2ae in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterExplainQuery.cpp:0: DB::InterpreterExplainQuery::execute() @ 0x00000000311787bf in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:51.556596 [ 2653 ] {1ab8ec21-034d-4023-b452-0c1c660b1456} executeQuery: Code: 201. DB::Exception: Quota for user `u02246` for 3155695200s has been exceeded: query_inserts = 3/2. Interval will end at 2069-12-31 07:00:00. Name of quota template: `q02246`. (QUOTA_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:60232) (comment: 02246_async_insert_quota.sh) (in query: INSERT INTO async_inserts_02246 VALUES ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&, String&&, String&&, String&&) @ 0x000000002e14494a in /usr/bin/clickhouse 3. ./build_docker/./src/Access/EnabledQuota.cpp:32: DB::EnabledQuota::Impl::throwQuotaExceed(String const&, String const&, DB::QuotaType, unsigned long, unsigned long, std::chrono::duration>, std::chrono::time_point>>) @ 0x000000002e143e46 in /usr/bin/clickhouse 4. ./build_docker/./src/Access/EnabledQuota.cpp:67: DB::EnabledQuota::Impl::used(String const&, DB::EnabledQuota::Intervals const&, DB::QuotaType, unsigned long, std::chrono::time_point>>, bool) @ 0x000000002e142dfd in /usr/bin/clickhouse 5. ./build_docker/./src/Access/EnabledQuota.cpp:0: DB::EnabledQuota::used(std::pair const&, bool) const @ 0x000000002e13e3c3 in /usr/bin/clickhouse 6. ./build_docker/./src/Access/EnabledQuota.cpp:234: DB::EnabledQuota::used(DB::QuotaType, unsigned long, bool) const @ 0x000000002e13e026 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320ebe15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:25:51.575455 [ 2653 ] {1ab8ec21-034d-4023-b452-0c1c660b1456} TCPHandler: Code: 201. DB::Exception: Quota for user `u02246` for 3155695200s has been exceeded: query_inserts = 3/2. Interval will end at 2069-12-31 07:00:00. Name of quota template: `q02246`. (QUOTA_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&, String&&, String&&, String&&) @ 0x000000002e14494a in /usr/bin/clickhouse 3. ./build_docker/./src/Access/EnabledQuota.cpp:32: DB::EnabledQuota::Impl::throwQuotaExceed(String const&, String const&, DB::QuotaType, unsigned long, unsigned long, std::chrono::duration>, std::chrono::time_point>>) @ 0x000000002e143e46 in /usr/bin/clickhouse 4. ./build_docker/./src/Access/EnabledQuota.cpp:67: DB::EnabledQuota::Impl::used(String const&, DB::EnabledQuota::Intervals const&, DB::QuotaType, unsigned long, std::chrono::time_point>>, bool) @ 0x000000002e142dfd in /usr/bin/clickhouse 5. ./build_docker/./src/Access/EnabledQuota.cpp:0: DB::EnabledQuota::used(std::pair const&, bool) const @ 0x000000002e13e3c3 in /usr/bin/clickhouse 6. ./build_docker/./src/Access/EnabledQuota.cpp:234: DB::EnabledQuota::used(DB::QuotaType, unsigned long, bool) const @ 0x000000002e13e026 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320ebe15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:01.817755 [ 2844 ] {7451fab7-7c5d-45b0-a60d-af624faf5499} executeQuery: Code: 80. DB::Exception: DETACH TABLE is not allowed for Replicated databases. Use DETACH TABLE PERMANENTLY or SYSTEM RESTART REPLICA or set database_replicated_always_detach_permanently to 1. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:60480) (comment: 01532_primary_key_without_order_by_zookeeper.sql) (in query: DETACH TABLE merge_tree_pk;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [167]) @ 0x000000002f3d4549 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:679: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f38f843 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116cded in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:92: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000003116a56b in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168302 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:01.827228 [ 2844 ] {7451fab7-7c5d-45b0-a60d-af624faf5499} TCPHandler: Code: 80. DB::Exception: DETACH TABLE is not allowed for Replicated databases. Use DETACH TABLE PERMANENTLY or SYSTEM RESTART REPLICA or set database_replicated_always_detach_permanently to 1. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [167]) @ 0x000000002f3d4549 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:679: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f38f843 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116cded in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:92: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000003116a56b in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168302 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:05.435411 [ 2479 ] {4f4c784a-8b0d-42d3-bf05-b62d820c4516} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:26:05.601724 [ 2479 ] {4f4c784a-8b0d-42d3-bf05-b62d820c4516} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54714) (comment: 02555_davengers_rename_chain.sh) (in query: CREATE TABLE wrong_metadata( a UInt64, b UInt64, c UInt64 ) ENGINE ReplicatedMergeTree('/test/{database}/tables/wrong_metadata', '1') ORDER BY tuple() SETTINGS min_bytes_for_wide_part = 0), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:05.623440 [ 2479 ] {4f4c784a-8b0d-42d3-bf05-b62d820c4516} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:06.062209 [ 3885 ] {35fa19d3-9b46-4fed-b64d-f99c695498c9} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54730) (comment: 02555_davengers_rename_chain.sh) (in query: INSERT INTO wrong_metadata VALUES ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:06.154246 [ 3885 ] {35fa19d3-9b46-4fed-b64d-f99c695498c9} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:06.847890 [ 2611 ] {96402c64-3fa2-49d1-99de-25f8ad00f1b1} executeQuery: Code: 395. DB::Exception: Ok: while executing 'FUNCTION throwIf(greater(number, 10000000) :: 1, 'Ok' :: 4) -> throwIf(greater(number, 10000000), 'Ok') UInt8 : 3'. (FUNCTION_THROW_IF_VALUE_IS_NON_ZERO) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54666) (comment: 01302_aggregate_state_exception_memory_leak.sh) (in query: SELECT groupArrayIfState(('Hello, world' AS s) || s || s || s || s || s || s || s || s || s, NOT throwIf(number > 10000000, 'Ok')) FROM system.numbers_mt GROUP BY number % 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::createRuntime(int, String const&) @ 0x000000001ab7168c in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionThrowIf::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001ab6b118 in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:07.261293 [ 3885 ] {e256d514-b540-44ac-9694-dee76f5704a4} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54746) (comment: 02555_davengers_rename_chain.sh) (in query: ALTER TABLE wrong_metadata RENAME COLUMN a TO a1, RENAME COLUMN b to b1 SETTINGS replication_alter_partitions_sync = 0), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:07.270163 [ 3885 ] {e256d514-b540-44ac-9694-dee76f5704a4} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:07.748119 [ 3885 ] {c57f6c18-bd16-4ae6-af88-e6f6aef55fbe} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54756) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:07.767634 [ 3885 ] {c57f6c18-bd16-4ae6-af88-e6f6aef55fbe} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:08.235220 [ 2479 ] {ce07eca9-9e12-4dea-96b8-a9df0b6435f8} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54776) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:08.257590 [ 2479 ] {ce07eca9-9e12-4dea-96b8-a9df0b6435f8} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:08.386711 [ 2611 ] {96402c64-3fa2-49d1-99de-25f8ad00f1b1} TCPHandler: Code: 395. DB::Exception: Ok: while executing 'FUNCTION throwIf(greater(number, 10000000) :: 1, 'Ok' :: 4) -> throwIf(greater(number, 10000000), 'Ok') UInt8 : 3'. (FUNCTION_THROW_IF_VALUE_IS_NON_ZERO), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::createRuntime(int, String const&) @ 0x000000001ab7168c in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionThrowIf::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001ab6b118 in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:08.849183 [ 2611 ] {6aaeb106-4601-4ae8-90fb-1af9855dd584} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54798) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:09.015362 [ 2611 ] {6aaeb106-4601-4ae8-90fb-1af9855dd584} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:09.563309 [ 2611 ] {952e082e-4375-4332-9894-2dadb04d8f90} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46418) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:09.569325 [ 2611 ] {952e082e-4375-4332-9894-2dadb04d8f90} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:10.168270 [ 2611 ] {3296af18-c4de-4451-b385-9d0685fb12d7} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46430) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:10.176246 [ 2611 ] {3296af18-c4de-4451-b385-9d0685fb12d7} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:10.793521 [ 2611 ] {3d4ee4f0-48bb-49d2-ac1c-1bbc90b2ae8f} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46442) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:10.796519 [ 2611 ] {3d4ee4f0-48bb-49d2-ac1c-1bbc90b2ae8f} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:11.273392 [ 2611 ] {d4c8b018-3de2-409f-9ea4-5b447713f615} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46450) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:11.307259 [ 2611 ] {d4c8b018-3de2-409f-9ea4-5b447713f615} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:11.364042 [ 3749 ] {d1cee2dc-3504-409d-9d93-978fce310c2b} executeQuery: Code: 395. DB::Exception: Ok: while executing 'FUNCTION throwIf(greater(number, 10000000) :: 1, 'Ok' :: 4) -> throwIf(greater(number, 10000000), 'Ok') UInt8 : 3'. (FUNCTION_THROW_IF_VALUE_IS_NON_ZERO) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54810) (comment: 01302_aggregate_state_exception_memory_leak.sh) (in query: SELECT groupArrayIfState(('Hello, world' AS s) || s || s || s || s || s || s || s || s || s, NOT throwIf(number > 10000000, 'Ok')) FROM system.numbers_mt GROUP BY number % 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::createRuntime(int, String const&) @ 0x000000001ab7168c in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionThrowIf::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001ab6b118 in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:11.878245 [ 2611 ] {64435783-e938-4ae4-a6a9-1f73c1402b1b} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46464) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:11.991320 [ 2611 ] {64435783-e938-4ae4-a6a9-1f73c1402b1b} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:12.458387 [ 3885 ] {30e48519-f095-4c92-9221-87d3f51852be} executeQuery: Code: 48. DB::Exception: ReplicatedMergeTree (table test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad)) does not support transactions. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54770) (comment: 02869_parallel_replicas_read_from_several.sql) (in query: insert into t1 select number, number from numbers(1000);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/IInterpreter.cpp:49: DB::IInterpreter::checkStorageSupportsTransactionsIfNeeded(std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000031142f3f in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab3f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:12.562664 [ 3885 ] {30e48519-f095-4c92-9221-87d3f51852be} TCPHandler: Code: 48. DB::Exception: ReplicatedMergeTree (table test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad)) does not support transactions. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/IInterpreter.cpp:49: DB::IInterpreter::checkStorageSupportsTransactionsIfNeeded(std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000031142f3f in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab3f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:12.640968 [ 3749 ] {d1cee2dc-3504-409d-9d93-978fce310c2b} TCPHandler: Code: 395. DB::Exception: Ok: while executing 'FUNCTION throwIf(greater(number, 10000000) :: 1, 'Ok' :: 4) -> throwIf(greater(number, 10000000), 'Ok') UInt8 : 3'. (FUNCTION_THROW_IF_VALUE_IS_NON_ZERO), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::createRuntime(int, String const&) @ 0x000000001ab7168c in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionThrowIf::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001ab6b118 in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:12.641358 [ 2487 ] {f4aaa317-cb6f-4228-8a88-64b9a1f26d7e} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46486) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:12.661917 [ 2487 ] {f4aaa317-cb6f-4228-8a88-64b9a1f26d7e} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:12.980949 [ 2479 ] {e6cde80c-7393-409f-a7a8-787d8880fe04} executeQuery: Code: 48. DB::Exception: ReplicatedMergeTree (table test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad)) does not support transactions. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:52418) (comment: 02869_parallel_replicas_read_from_several.sql) (in query: DROP DATABASE IF EXISTS test_dh4tzbjk ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/IInterpreter.cpp:49: DB::IInterpreter::checkStorageSupportsTransactionsIfNeeded(std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000031142f3f in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116bfb7 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:376: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr&, std::vector, DB::UUIDTag>, std::allocator, DB::UUIDTag>>>&) @ 0x00000000311734b2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x000000003116ac2b in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168341 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 11. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:12.994272 [ 2479 ] {e6cde80c-7393-409f-a7a8-787d8880fe04} DynamicQueryHandler: Code: 48. DB::Exception: ReplicatedMergeTree (table test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad)) does not support transactions. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/IInterpreter.cpp:49: DB::IInterpreter::checkStorageSupportsTransactionsIfNeeded(std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000031142f3f in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116bfb7 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:376: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr&, std::vector, DB::UUIDTag>, std::allocator, DB::UUIDTag>>>&) @ 0x00000000311734b2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x000000003116ac2b in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168341 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 11. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:13.198437 [ 2611 ] {ac7cfaf5-e0f3-41c3-bd0d-c20cea3d8851} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46522) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:13.223220 [ 2611 ] {ac7cfaf5-e0f3-41c3-bd0d-c20cea3d8851} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:13.826280 [ 3748 ] {481bfee3-eac3-4450-bd6b-c1f35468445c} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46540) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:13.843381 [ 3748 ] {481bfee3-eac3-4450-bd6b-c1f35468445c} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:14.498495 [ 2570 ] {80fd9b92-138b-4482-8c7e-609712ab8c23} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46570) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:14.662939 [ 2570 ] {80fd9b92-138b-4482-8c7e-609712ab8c23} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:14.663291 [ 2005 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:15.248076 [ 2570 ] {7e046ff1-e028-44fa-a70e-07da708ca95d} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46586) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:15.256401 [ 2570 ] {7e046ff1-e028-44fa-a70e-07da708ca95d} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:15.708235 [ 2040 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:15.715445 [ 2034 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:15.874457 [ 3748 ] {c1c4f03e-2161-4877-9e71-189d8c95aa85} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46592) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:15.894806 [ 3748 ] {c1c4f03e-2161-4877-9e71-189d8c95aa85} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:15.934138 [ 3885 ] {027606ad-ee19-4d81-88c0-b3788902cbea} executeQuery: Code: 395. DB::Exception: Ok: while executing 'FUNCTION throwIf(greater(number, 10000000) :: 1, 'Ok' :: 4) -> throwIf(greater(number, 10000000), 'Ok') UInt8 : 3'. (FUNCTION_THROW_IF_VALUE_IS_NON_ZERO) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46508) (comment: 01302_aggregate_state_exception_memory_leak.sh) (in query: SELECT groupArrayIfState(('Hello, world' AS s) || s || s || s || s || s || s || s || s || s, NOT throwIf(number > 10000000, 'Ok')) FROM system.numbers_mt GROUP BY number % 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::createRuntime(int, String const&) @ 0x000000001ab7168c in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionThrowIf::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001ab6b118 in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:16.544730 [ 3748 ] {11a53fbd-001f-4bf4-bd93-574b5dfc4fe5} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46622) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:16.556888 [ 3748 ] {11a53fbd-001f-4bf4-bd93-574b5dfc4fe5} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:16.722423 [ 2001 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:16.746687 [ 2037 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:17.242956 [ 2082 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:17.481276 [ 3748 ] {363a1d62-5484-4ac2-b81e-57482097314f} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46642) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:17.481776 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7cad99ab-25c9-4fc4-8b87-9cda5683f665::202410_1_21_4}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x000000001d610bdd in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x000000001d60c57c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::finish() @ 0x000000003499483e in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992afd in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:17.500553 [ 3748 ] {363a1d62-5484-4ac2-b81e-57482097314f} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:17.772216 [ 2095 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:17.782486 [ 2102 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:17.937438 [ 3885 ] {027606ad-ee19-4d81-88c0-b3788902cbea} TCPHandler: Code: 395. DB::Exception: Ok: while executing 'FUNCTION throwIf(greater(number, 10000000) :: 1, 'Ok' :: 4) -> throwIf(greater(number, 10000000), 'Ok') UInt8 : 3'. (FUNCTION_THROW_IF_VALUE_IS_NON_ZERO), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::createRuntime(int, String const&) @ 0x000000001ab7168c in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionThrowIf::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001ab6b118 in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:18.245756 [ 1992 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:18.278196 [ 3740 ] {c2570c9f-97e9-41c7-b012-ecce2dc97fdd} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46676) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:18.301975 [ 3740 ] {c2570c9f-97e9-41c7-b012-ecce2dc97fdd} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:18.710416 [ 3740 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46724) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:18.710708 [ 3731 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46774) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:18.712235 [ 3510 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46762) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:18.727286 [ 3740 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:18.735543 [ 3731 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:18.742929 [ 3510 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:18.779594 [ 1984 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:18.799925 [ 2006 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:19.775208 [ 3885 ] {c94d57d1-dd4a-472c-b4f0-6f0e8584c11a} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46792) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:19.776748 [ 2844 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46034) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:19.776797 [ 2653 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46054) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:19.777045 [ 2020 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:19.777060 [ 3731 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46036) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:19.780218 [ 3885 ] {c94d57d1-dd4a-472c-b4f0-6f0e8584c11a} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:19.787300 [ 2844 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:19.778660 [ 2212 ] {} test_w0d8q3ry.tableOut (88b6b125-298e-4357-9233-56dc4a9b84de): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 86. DB::HTTPException: Received error from remote server /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02916%2Ftest_w0d8q3ry%2Ftable%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false&remote_fs_metadata=s3. HTTP status code: 500 Internal Server Error, body: Code: 236. DB::Exception: Could not exchange part all_0_0_0 as it's in preActive state (1000 ms) and it uses zero copy replication. This is expected behaviour and the client will retry fetching the part automatically. (ABORTED) (version 23.8.16.42.altinitystable (altinity build)). (RECEIVED_ERROR_FROM_REMOTE_IO_SERVER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String const&, int&&, String const&, String const&) @ 0x000000001dd06a80 in /usr/bin/clickhouse 3. ./build_docker/./src/IO/HTTPCommon.cpp:418: DB::HTTPException::HTTPException(int, String const&, Poco::Net::HTTPResponse::HTTPStatus, String const&, String const&) @ 0x000000001dd063ad in /usr/bin/clickhouse 4. ./build_docker/./src/IO/HTTPCommon.cpp:407: DB::assertResponseIsOk(Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, std::basic_istream>&, bool) @ 0x000000001dcfa4d1 in /usr/bin/clickhouse 5. ./build_docker/./src/IO/HTTPCommon.cpp:386: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa115 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 7. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 10. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 24. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:19.808090 [ 2653 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:19.827889 [ 3731 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:19.830050 [ 2036 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:19.840192 [ 2039 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:19.929373 [ 3745 ] {hello_01003} executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46736) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:19.962850 [ 3745 ] {hello_01003} TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:20.378069 [ 2653 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46124) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:20.380332 [ 1910 ] {f5a4a977-48e7-46d8-b7d1-ab685b6f2aef} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46138) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:20.392404 [ 2559 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46146) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:20.400463 [ 2653 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:20.407274 [ 1910 ] {f5a4a977-48e7-46d8-b7d1-ab685b6f2aef} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:20.427353 [ 2559 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:20.494201 [ 2694 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46156) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:20.508717 [ 2694 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:20.784003 [ 2043 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:20.852528 [ 2008 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:20.852915 [ 2053 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:21.305912 [ 3737 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46230) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:21.328660 [ 3737 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:21.341723 [ 2694 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46220) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:21.355264 [ 2694 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:21.364185 [ 3733 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46252) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:21.365000 [ 3740 ] {61890e2c-bc39-421a-aab2-12e0f417d3e5} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46246) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:21.401497 [ 3733 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:21.422419 [ 3740 ] {61890e2c-bc39-421a-aab2-12e0f417d3e5} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:21.619057 [ 2209 ] {} test_w0d8q3ry.tableOut (88b6b125-298e-4357-9233-56dc4a9b84de): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 86. DB::HTTPException: Received error from remote server /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02916%2Ftest_w0d8q3ry%2Ftable%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false&remote_fs_metadata=s3. HTTP status code: 500 Internal Server Error, body: Code: 236. DB::Exception: Could not exchange part all_0_0_0 as it's in preActive state (1000 ms) and it uses zero copy replication. This is expected behaviour and the client will retry fetching the part automatically. (ABORTED) (version 23.8.16.42.altinitystable (altinity build)). (RECEIVED_ERROR_FROM_REMOTE_IO_SERVER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String const&, int&&, String const&, String const&) @ 0x000000001dd06a80 in /usr/bin/clickhouse 3. ./build_docker/./src/IO/HTTPCommon.cpp:418: DB::HTTPException::HTTPException(int, String const&, Poco::Net::HTTPResponse::HTTPStatus, String const&, String const&) @ 0x000000001dd063ad in /usr/bin/clickhouse 4. ./build_docker/./src/IO/HTTPCommon.cpp:407: DB::assertResponseIsOk(Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, std::basic_istream>&, bool) @ 0x000000001dcfa4d1 in /usr/bin/clickhouse 5. ./build_docker/./src/IO/HTTPCommon.cpp:386: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa115 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 7. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 10. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 24. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:21.790530 [ 2071 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:21.849844 [ 3749 ] {hello_01003} executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46122) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:21.858487 [ 2079 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:21.862994 [ 2089 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:21.863487 [ 3749 ] {hello_01003} TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:22.279777 [ 1910 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46342) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:22.283276 [ 3740 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46304) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:22.304122 [ 1910 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:22.325222 [ 2694 ] {93aca130-a283-48dd-8ad8-03ac4671bab0} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46348) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:22.410996 [ 3740 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:22.435253 [ 2694 ] {93aca130-a283-48dd-8ad8-03ac4671bab0} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:22.506836 [ 3749 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46370) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:22.619793 [ 3749 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:22.806608 [ 3733 ] {hello_01003} executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46314) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:22.829994 [ 3733 ] {hello_01003} TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:22.891792 [ 2107 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:22.895424 [ 1989 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:22.899902 [ 1979 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:23.034290 [ 2801 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46406) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:23.048686 [ 2801 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:23.047884 [ 3745 ] {b6a15a4b-95af-4557-b855-8a6d53e4ba4e} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46412) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:23.078262 [ 3745 ] {b6a15a4b-95af-4557-b855-8a6d53e4ba4e} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:23.088921 [ 3733 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46422) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:23.104514 [ 3733 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:23.180978 [ 3746 ] {dd0f2f43-867f-4f13-a797-cb7c83ebafaa} executeQuery: Code: 395. DB::Exception: Ok: while executing 'FUNCTION throwIf(greater(number, 10000000) :: 1, 'Ok' :: 4) -> throwIf(greater(number, 10000000), 'Ok') UInt8 : 3'. (FUNCTION_THROW_IF_VALUE_IS_NON_ZERO) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46712) (comment: 01302_aggregate_state_exception_memory_leak.sh) (in query: SELECT groupArrayIfState(('Hello, world' AS s) || s || s || s || s || s || s || s || s || s, NOT throwIf(number > 10000000, 'Ok')) FROM system.numbers_mt GROUP BY number % 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::createRuntime(int, String const&) @ 0x000000001ab7168c in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionThrowIf::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001ab6b118 in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:23.412894 [ 3749 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46480) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:23.436116 [ 3749 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:23.509896 [ 1910 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46488) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:23.517093 [ 1910 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:23.578621 [ 2694 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46498) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:23.587529 [ 2694 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:23.844105 [ 2801 ] {6963844a-793d-4c21-906b-dfecabf6eb7f} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46510) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:23.883678 [ 2801 ] {6963844a-793d-4c21-906b-dfecabf6eb7f} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:23.898397 [ 2002 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:23.908135 [ 1980 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:23.913358 [ 1993 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:24.186206 [ 3740 ] {hello_01003} executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46398) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:24.198594 [ 3740 ] {hello_01003} TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:24.227807 [ 2694 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46546) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:24.234234 [ 2694 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:24.239967 [ 3885 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46526) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:24.263200 [ 3885 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:24.531810 [ 2694 ] {2b26f4f8-4c7f-4404-a425-6b2515660843} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46578) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:24.647335 [ 2694 ] {2b26f4f8-4c7f-4404-a425-6b2515660843} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:24.939725 [ 2000 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:24.940780 [ 2020 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:24.948080 [ 2025 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:25.097298 [ 3885 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46584) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.119992 [ 3885 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.127597 [ 3740 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46600) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.137481 [ 3746 ] {dd0f2f43-867f-4f13-a797-cb7c83ebafaa} TCPHandler: Code: 395. DB::Exception: Ok: while executing 'FUNCTION throwIf(greater(number, 10000000) :: 1, 'Ok' :: 4) -> throwIf(greater(number, 10000000), 'Ok') UInt8 : 3'. (FUNCTION_THROW_IF_VALUE_IS_NON_ZERO), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::createRuntime(int, String const&) @ 0x000000001ab7168c in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionThrowIf::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001ab6b118 in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.147892 [ 3740 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.148156 [ 3749 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46604) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.165191 [ 3749 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.315316 [ 3745 ] {a5836645-f6d8-4dfd-be3c-003ddbe95e7b} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46642) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.320872 [ 3745 ] {a5836645-f6d8-4dfd-be3c-003ddbe95e7b} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.575846 [ 3737 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46700) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.577624 [ 3737 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.577746 [ 3740 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46714) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.579587 [ 3740 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.769953 [ 2479 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46696) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.773709 [ 2479 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.887900 [ 3745 ] {a9384f3f-40eb-4f32-b790-d79fd5d1e01c} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46752) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.894857 [ 3745 ] {a9384f3f-40eb-4f32-b790-d79fd5d1e01c} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:25.958263 [ 2050 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:25.969418 [ 2052 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:25.969331 [ 2051 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:25.971569 [ 1910 ] {hello_01003} executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46536) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:26.074770 [ 1910 ] {hello_01003} TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:26.486864 [ 2801 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46772) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:26.544175 [ 3745 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46786) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:26.569526 [ 1910 ] {37eaf209-ad58-4c9f-8c01-571017cd34f6} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46788) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:26.589111 [ 1910 ] {37eaf209-ad58-4c9f-8c01-571017cd34f6} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:26.599878 [ 2844 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46796) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:26.611629 [ 2801 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:26.616287 [ 2844 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:26.685164 [ 3745 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:26.840775 [ 2479 ] {hello_01003} executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46756) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:26.872664 [ 2479 ] {hello_01003} TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:26.968625 [ 2057 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:27.027193 [ 2060 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:27.028838 [ 2076 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:27.221032 [ 2801 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46854) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:27.228315 [ 2801 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:27.388674 [ 2844 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46874) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:27.392528 [ 3733 ] {c2036b96-e54f-4578-ad55-56b94e1ed058} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46842) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:27.407939 [ 2844 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:27.408699 [ 2570 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46884) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:27.415310 [ 3733 ] {c2036b96-e54f-4578-ad55-56b94e1ed058} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:27.423819 [ 2570 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:27.705443 [ 3885 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46902) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:27.739802 [ 3885 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:27.848835 [ 3737 ] {hello_01003} executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46826) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:27.864522 [ 3737 ] {hello_01003} TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:27.886331 [ 3885 ] {hello_01003} executeQuery: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46912) (comment: 01003_kill_query_race_condition.sh) (in query: SELECT count() FROM numbers(1000000000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:27.910322 [ 3885 ] {hello_01003} TCPHandler: Code: 216. DB::Exception: Query with id = hello_01003 is already running. (QUERY_WITH_SAME_ID_IS_ALREADY_RUNNING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:161: DB::ProcessList::insert(String const&, DB::IAST const*, std::shared_ptr, unsigned long) @ 0x00000000318847a5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e976e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:27.983529 [ 2054 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:28.039507 [ 2087 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:28.039800 [ 2072 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:28.054499 [ 2801 ] {e2706cea-b778-42a7-9e51-ad63077caad2} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46958) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:28.076346 [ 2801 ] {e2706cea-b778-42a7-9e51-ad63077caad2} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:28.128716 [ 1910 ] {98ad3f11-2579-472b-a968-b49e990b169d} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::1]:9000 -> [::1]:46918). (NETWORK_ERROR) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46918) (comment: 01003_kill_query_race_condition.sh) (in query: SHOW PROCESSLIST), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a58a in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x0000000034ef2754 in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed731c in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 11. ? @ 0x00007f11b339dac3 in ? 12. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:28.136056 [ 3740 ] {da3f4aed-ef86-4cee-bc04-a4dbe6a93658} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:46934). (NETWORK_ERROR) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46934) (comment: 01003_kill_query_race_condition.sh) (in query: SHOW PROCESSLIST), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProfileInfo(DB::ProfileInfo const&) @ 0x0000000034ef8d6e in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:967: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x0000000034eef305 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:503: DB::TCPHandler::runImpl() @ 0x0000000034ed6fc7 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:28.188400 [ 1910 ] {98ad3f11-2579-472b-a968-b49e990b169d} TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:46918). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x0000000034f12fcc in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__hash_table:1473: DB::TCPHandler::sendLogs() @ 0x0000000034ef1d88 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed8b98 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:28.188164 [ 3740 ] {da3f4aed-ef86-4cee-bc04-a4dbe6a93658} TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:46934). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x0000000034f12fcc in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__hash_table:1473: DB::TCPHandler::sendLogs() @ 0x0000000034ef1d88 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed8b98 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:28.191820 [ 1910 ] {98ad3f11-2579-472b-a968-b49e990b169d} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::1]:9000 -> [::1]:46918). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a58a in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x0000000034ef2754 in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed731c in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 11. ? @ 0x00007f11b339dac3 in ? 12. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:28.192523 [ 3740 ] {da3f4aed-ef86-4cee-bc04-a4dbe6a93658} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:46934). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProfileInfo(DB::ProfileInfo const&) @ 0x0000000034ef8d6e in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:967: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x0000000034eef305 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:503: DB::TCPHandler::runImpl() @ 0x0000000034ed6fc7 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:28.199649 [ 3740 ] {da3f4aed-ef86-4cee-bc04-a4dbe6a93658} TCPHandler: Client has gone away. 2024.10.22 00:26:28.202970 [ 1910 ] {98ad3f11-2579-472b-a968-b49e990b169d} TCPHandler: Client has gone away. 2024.10.22 00:26:28.584754 [ 3885 ] {c2e2186e-d3da-40d2-a078-18fe06453fa2} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47000) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:28.675361 [ 3885 ] {c2e2186e-d3da-40d2-a078-18fe06453fa2} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:29.594618 [ 1910 ] {1a57c372-e644-41d8-8323-d041811af206} executeQuery: Code: 42. DB::Exception: Number of arguments for function extractAllGroupsHorizontal doesn't match: passed 0, should be 2: While processing extractAllGroupsHorizontal(). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47008) (comment: 01246_extractAllGroupsHorizontal.sql) (in query: -- error cases SELECT extractAllGroupsHorizontal();), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&, unsigned long&) @ 0x000000002827d54a in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/IFunction.cpp:398: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x000000002d8a3ae4 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a49a8 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:26:29.594782 [ 1987 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:29.594831 [ 3749 ] {9d53d8a3-6362-49b1-9903-073303369032} executeQuery: Code: 395. DB::Exception: Ok: while executing 'FUNCTION throwIf(greater(number, 10000000) :: 1, 'Ok' :: 4) -> throwIf(greater(number, 10000000), 'Ok') UInt8 : 3'. (FUNCTION_THROW_IF_VALUE_IS_NON_ZERO) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46668) (comment: 01302_aggregate_state_exception_memory_leak.sh) (in query: SELECT groupArrayIfState(('Hello, world' AS s) || s || s || s || s || s || s || s || s || s, NOT throwIf(number > 10000000, 'Ok')) FROM system.numbers_mt GROUP BY number % 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::createRuntime(int, String const&) @ 0x000000001ab7168c in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionThrowIf::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001ab6b118 in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:29.594748 [ 2104 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:29.594950 [ 1986 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:29.595239 [ 3740 ] {06bf7ac3-cbb3-4b72-b8f2-f8bf37326120} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54456) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:29.605082 [ 1910 ] {1a57c372-e644-41d8-8323-d041811af206} TCPHandler: Code: 42. DB::Exception: Number of arguments for function extractAllGroupsHorizontal doesn't match: passed 0, should be 2: While processing extractAllGroupsHorizontal(). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&, unsigned long&) @ 0x000000002827d54a in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/IFunction.cpp:398: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x000000002d8a3ae4 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a49a8 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:26:29.611364 [ 3740 ] {06bf7ac3-cbb3-4b72-b8f2-f8bf37326120} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:29.704724 [ 1910 ] {5f1969a1-9997-471c-8be5-359b09654eb7} executeQuery: Code: 42. DB::Exception: Number of arguments for function extractAllGroupsHorizontal doesn't match: passed 1, should be 2: While processing extractAllGroupsHorizontal('hello'). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47008) (comment: 01246_extractAllGroupsHorizontal.sql) (in query: SELECT extractAllGroupsHorizontal('hello');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&, unsigned long&) @ 0x000000002827d54a in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/IFunction.cpp:398: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x000000002d8a3ae4 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a49a8 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:26:29.708091 [ 1910 ] {5f1969a1-9997-471c-8be5-359b09654eb7} TCPHandler: Code: 42. DB::Exception: Number of arguments for function extractAllGroupsHorizontal doesn't match: passed 1, should be 2: While processing extractAllGroupsHorizontal('hello'). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&, unsigned long&) @ 0x000000002827d54a in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/IFunction.cpp:398: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x000000002d8a3ae4 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a49a8 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:26:29.960049 [ 1910 ] {34de2047-bc72-4327-99be-f4ced93f7e73} executeQuery: Code: 43. DB::Exception: Illegal type of argument #2 'needle' of function extractAllGroupsHorizontal, expected const String or const FixedString, got UInt8: While processing extractAllGroupsHorizontal('hello', 123). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47008) (comment: 01246_extractAllGroupsHorizontal.sql) (in query: SELECT extractAllGroupsHorizontal('hello', 123);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::FunctionExtractAllGroups<(anonymous namespace)::HorizontalImpl>::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011908353 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:26:29.968763 [ 1910 ] {34de2047-bc72-4327-99be-f4ced93f7e73} TCPHandler: Code: 43. DB::Exception: Illegal type of argument #2 'needle' of function extractAllGroupsHorizontal, expected const String or const FixedString, got UInt8: While processing extractAllGroupsHorizontal('hello', 123). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::FunctionExtractAllGroups<(anonymous namespace)::HorizontalImpl>::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011908353 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:26:30.243787 [ 1910 ] {70cfa340-881c-4139-a353-44a28f6dbbcb} executeQuery: Code: 43. DB::Exception: Illegal type of argument #1 'haystack' of function extractAllGroupsHorizontal, expected const String or const FixedString, got UInt8: While processing extractAllGroupsHorizontal(123, 'world'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47008) (comment: 01246_extractAllGroupsHorizontal.sql) (in query: SELECT extractAllGroupsHorizontal(123, 'world');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::FunctionExtractAllGroups<(anonymous namespace)::HorizontalImpl>::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011908353 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:26:30.261985 [ 1910 ] {70cfa340-881c-4139-a353-44a28f6dbbcb} TCPHandler: Code: 43. DB::Exception: Illegal type of argument #1 'haystack' of function extractAllGroupsHorizontal, expected const String or const FixedString, got UInt8: While processing extractAllGroupsHorizontal(123, 'world'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::FunctionExtractAllGroups<(anonymous namespace)::HorizontalImpl>::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011908353 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:26:30.384830 [ 3740 ] {c07f4d9c-c787-4eea-984c-544a825c52a2} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54468) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:30.387315 [ 3740 ] {c07f4d9c-c787-4eea-984c-544a825c52a2} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:30.731638 [ 2004 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:30.731809 [ 2017 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:30.731914 [ 2023 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:30.732417 [ 1910 ] {3891e659-cb37-4e6d-a5fa-e100673f73f9} executeQuery: Code: 427. DB::Exception: OptimizedRegularExpression: cannot compile re2: (((, error: missing ): (((. Look at https://github.com/google/re2/wiki/Syntax for reference. Please note that if you specify regex as an SQL string literal, the slashes have to be additionally escaped. For example, to match an opening brace, write '\(' -- the first slash is for SQL and the second one is for regex: While processing extractAllGroupsHorizontal('hello world', '((('). (CANNOT_COMPILE_REGEXP) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47008) (comment: 01246_extractAllGroupsHorizontal.sql) (in query: SELECT extractAllGroupsHorizontal('hello world', '(((');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String const&) @ 0x000000000cf74af6 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/OptimizedRegularExpression.cpp:503: OptimizedRegularExpressionImpl::OptimizedRegularExpressionImpl(String const&, int) @ 0x000000001d622c82 in /usr/bin/clickhouse 4. DB::FunctionExtractAllGroups<(anonymous namespace)::HorizontalImpl>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001190456b in /usr/bin/clickhouse 5. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 11. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:26:30.743184 [ 1910 ] {3891e659-cb37-4e6d-a5fa-e100673f73f9} TCPHandler: Code: 427. DB::Exception: OptimizedRegularExpression: cannot compile re2: (((, error: missing ): (((. Look at https://github.com/google/re2/wiki/Syntax for reference. Please note that if you specify regex as an SQL string literal, the slashes have to be additionally escaped. For example, to match an opening brace, write '\(' -- the first slash is for SQL and the second one is for regex: While processing extractAllGroupsHorizontal('hello world', '((('). (CANNOT_COMPILE_REGEXP), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String const&) @ 0x000000000cf74af6 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/OptimizedRegularExpression.cpp:503: OptimizedRegularExpressionImpl::OptimizedRegularExpressionImpl(String const&, int) @ 0x000000001d622c82 in /usr/bin/clickhouse 4. DB::FunctionExtractAllGroups<(anonymous namespace)::HorizontalImpl>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001190456b in /usr/bin/clickhouse 5. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 6. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 9. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 11. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 2024.10.22 00:26:30.868601 [ 1910 ] {17b7fdc1-cc68-4182-9f55-d75057d843c5} executeQuery: Code: 44. DB::Exception: Illegal type of argument #2 'needle' of function extractAllGroupsHorizontal, expected const String or const FixedString, got String: While processing extractAllGroupsHorizontal('hello world', materialize('\\w+')). (ILLEGAL_COLUMN) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47008) (comment: 01246_extractAllGroupsHorizontal.sql) (in query: SELECT extractAllGroupsHorizontal('hello world', materialize('\\w+'));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::FunctionExtractAllGroups<(anonymous namespace)::HorizontalImpl>::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011908353 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:26:30.878891 [ 1910 ] {17b7fdc1-cc68-4182-9f55-d75057d843c5} TCPHandler: Code: 44. DB::Exception: Illegal type of argument #2 'needle' of function extractAllGroupsHorizontal, expected const String or const FixedString, got String: While processing extractAllGroupsHorizontal('hello world', materialize('\\w+')). (ILLEGAL_COLUMN), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::FunctionExtractAllGroups<(anonymous namespace)::HorizontalImpl>::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011908353 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:26:31.290870 [ 3749 ] {9d53d8a3-6362-49b1-9903-073303369032} TCPHandler: Code: 395. DB::Exception: Ok: while executing 'FUNCTION throwIf(greater(number, 10000000) :: 1, 'Ok' :: 4) -> throwIf(greater(number, 10000000), 'Ok') UInt8 : 3'. (FUNCTION_THROW_IF_VALUE_IS_NON_ZERO), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::createRuntime(int, String const&) @ 0x000000001ab7168c in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionThrowIf::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001ab6b118 in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:31.290947 [ 3885 ] {f8a3a7d0-3944-4ddb-af3a-1d102c7c0f8b} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54496) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:31.296261 [ 1910 ] {af225cda-f36e-4e2b-b4cf-4ab13b85552b} executeQuery: Code: 36. DB::Exception: There are no groups in regexp: \w+: While processing extractAllGroupsHorizontal('hello world', '\\w+'). (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47008) (comment: 01246_extractAllGroupsHorizontal.sql) (in query: SELECT extractAllGroupsHorizontal('hello world', '\\w+');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. DB::FunctionExtractAllGroups<(anonymous namespace)::HorizontalImpl>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x0000000011906a9d in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 10. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 31. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 2024.10.22 00:26:31.302812 [ 3885 ] {f8a3a7d0-3944-4ddb-af3a-1d102c7c0f8b} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:31.321950 [ 1910 ] {af225cda-f36e-4e2b-b4cf-4ab13b85552b} TCPHandler: Code: 36. DB::Exception: There are no groups in regexp: \w+: While processing extractAllGroupsHorizontal('hello world', '\\w+'). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. DB::FunctionExtractAllGroups<(anonymous namespace)::HorizontalImpl>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x0000000011906a9d in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 10. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 31. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 2024.10.22 00:26:31.682298 [ 1910 ] {c89bb95f-3d6b-41f2-ab12-ed78c3875683} executeQuery: Code: 128. DB::Exception: Too many matches per row (> 0) in the result of function extractAllGroupsHorizontal: While processing extractAllGroupsHorizontal('hello world', '(\\w+)'). (TOO_LARGE_ARRAY_SIZE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47008) (comment: 01246_extractAllGroupsHorizontal.sql) (in query: SELECT extractAllGroupsHorizontal('hello world', '(\\w+)') SETTINGS regexp_max_matches_per_row = 0;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception const&, String>(int, FormatStringHelperImpl const&>::type, std::type_identity::type>, DB::SettingFieldNumber const&, String&&) @ 0x0000000011909537 in /usr/bin/clickhouse 3. DB::FunctionExtractAllGroups<(anonymous namespace)::HorizontalImpl>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000119065e2 in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 10. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 31. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 2024.10.22 00:26:31.703988 [ 1910 ] {c89bb95f-3d6b-41f2-ab12-ed78c3875683} TCPHandler: Code: 128. DB::Exception: Too many matches per row (> 0) in the result of function extractAllGroupsHorizontal: While processing extractAllGroupsHorizontal('hello world', '(\\w+)'). (TOO_LARGE_ARRAY_SIZE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception const&, String>(int, FormatStringHelperImpl const&>::type, std::type_identity::type>, DB::SettingFieldNumber const&, String&&) @ 0x0000000011909537 in /usr/bin/clickhouse 3. DB::FunctionExtractAllGroups<(anonymous namespace)::HorizontalImpl>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000119065e2 in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 10. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 31. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 2024.10.22 00:26:31.734899 [ 2021 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:31.735251 [ 2032 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:31.736829 [ 2040 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:31.744166 [ 1910 ] {28233044-355c-430f-bb08-511a8abf4bc7} executeQuery: Code: 128. DB::Exception: Too many matches per row (> 1) in the result of function extractAllGroupsHorizontal: While processing extractAllGroupsHorizontal('hello world', '(\\w+)'). (TOO_LARGE_ARRAY_SIZE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47008) (comment: 01246_extractAllGroupsHorizontal.sql) (in query: SELECT extractAllGroupsHorizontal('hello world', '(\\w+)') SETTINGS regexp_max_matches_per_row = 1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception const&, String>(int, FormatStringHelperImpl const&>::type, std::type_identity::type>, DB::SettingFieldNumber const&, String&&) @ 0x0000000011909537 in /usr/bin/clickhouse 3. DB::FunctionExtractAllGroups<(anonymous namespace)::HorizontalImpl>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000119065e2 in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 10. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 31. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 2024.10.22 00:26:31.749526 [ 1910 ] {28233044-355c-430f-bb08-511a8abf4bc7} TCPHandler: Code: 128. DB::Exception: Too many matches per row (> 1) in the result of function extractAllGroupsHorizontal: While processing extractAllGroupsHorizontal('hello world', '(\\w+)'). (TOO_LARGE_ARRAY_SIZE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception const&, String>(int, FormatStringHelperImpl const&>::type, std::type_identity::type>, DB::SettingFieldNumber const&, String&&) @ 0x0000000011909537 in /usr/bin/clickhouse 3. DB::FunctionExtractAllGroups<(anonymous namespace)::HorizontalImpl>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000119065e2 in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 10. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 31. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 2024.10.22 00:26:31.900013 [ 3740 ] {bb334d16-f83b-421b-b2ee-f4fdcb8a915e} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54530) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:31.907758 [ 3740 ] {bb334d16-f83b-421b-b2ee-f4fdcb8a915e} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:32.431843 [ 2801 ] {33e5e980-45f5-41e7-9aa7-0629533628b6} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54556) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:32.438790 [ 2801 ] {33e5e980-45f5-41e7-9aa7-0629533628b6} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:32.748322 [ 2049 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:32.749424 [ 2058 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:32.750436 [ 2061 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:33.013762 [ 2801 ] {e256e50c-de13-41fb-89a1-d9263df1dc72} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54564) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:33.023066 [ 2801 ] {e256e50c-de13-41fb-89a1-d9263df1dc72} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:33.754306 [ 2079 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:33.754993 [ 2089 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:33.758567 [ 2080 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:33.795834 [ 2801 ] {fdda9e3d-efdf-4657-85e5-28dafd11aee2} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54566) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:33.821631 [ 2801 ] {fdda9e3d-efdf-4657-85e5-28dafd11aee2} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:34.501875 [ 2801 ] {655fe4b3-5f44-4cff-9c8c-c8f52e09bfc1} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54572) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:34.512137 [ 2801 ] {655fe4b3-5f44-4cff-9c8c-c8f52e09bfc1} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:34.769179 [ 2099 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:34.769358 [ 2092 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:34.769855 [ 2033 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:34.793917 [ 3885 ] {f27f5a6b-47e1-4d2f-8dae-521191760043} executeQuery: Code: 395. DB::Exception: Ok: while executing 'FUNCTION throwIf(greater(number, 10000000) :: 1, 'Ok' :: 4) -> throwIf(greater(number, 10000000), 'Ok') UInt8 : 3'. (FUNCTION_THROW_IF_VALUE_IS_NON_ZERO) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54516) (comment: 01302_aggregate_state_exception_memory_leak.sh) (in query: SELECT groupArrayIfState(('Hello, world' AS s) || s || s || s || s || s || s || s || s || s, NOT throwIf(number > 10000000, 'Ok')) FROM system.numbers_mt GROUP BY number % 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::createRuntime(int, String const&) @ 0x000000001ab7168c in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionThrowIf::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001ab6b118 in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:35.169667 [ 3733 ] {0ce895d5-f42d-4659-a072-9ebb2cff2303} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54580) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:35.184791 [ 3733 ] {0ce895d5-f42d-4659-a072-9ebb2cff2303} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:35.712743 [ 2801 ] {1d3340a9-f119-43b6-99b1-937c950ebd58} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54608) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:35.775565 [ 1999 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:35.775722 [ 2031 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:35.775809 [ 1997 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:35.822867 [ 2801 ] {1d3340a9-f119-43b6-99b1-937c950ebd58} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:36.119992 [ 3885 ] {f27f5a6b-47e1-4d2f-8dae-521191760043} TCPHandler: Code: 395. DB::Exception: Ok: while executing 'FUNCTION throwIf(greater(number, 10000000) :: 1, 'Ok' :: 4) -> throwIf(greater(number, 10000000), 'Ok') UInt8 : 3'. (FUNCTION_THROW_IF_VALUE_IS_NON_ZERO), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::createRuntime(int, String const&) @ 0x000000001ab7168c in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionThrowIf::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001ab6b118 in /usr/bin/clickhouse 4. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 5. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:36.435697 [ 2570 ] {94f45a09-c238-42da-b811-a9142abf8232} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54624) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:36.444114 [ 2570 ] {94f45a09-c238-42da-b811-a9142abf8232} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:36.777831 [ 2014 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:36.778615 [ 2010 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:36.778682 [ 2018 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:36.982109 [ 3746 ] {ff642e65-65b3-4742-af30-248770b8277f} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54638) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:37.089497 [ 3746 ] {ff642e65-65b3-4742-af30-248770b8277f} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:37.599004 [ 2570 ] {fea1d29e-aff9-4b41-9203-b3a8817d4153} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54642) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:37.615279 [ 2570 ] {fea1d29e-aff9-4b41-9203-b3a8817d4153} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:37.783040 [ 2011 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:37.791684 [ 2027 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:37.792019 [ 2035 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:38.199615 [ 3746 ] {96ca11a9-f8e4-4af5-b8c6-8f65d038fbc4} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54654) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:38.205585 [ 3746 ] {96ca11a9-f8e4-4af5-b8c6-8f65d038fbc4} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:38.215882 [ 2570 ] {031ae651-79ad-4e26-9b83-94381eea89df} executeQuery: Code: 60. DB::Exception: Table test_7.test_table_for_01070_exception_code_in_query_log_table does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54648) (comment: 01070_exception_code_in_query_log_table.sql) (in query: SELECT * FROM test_table_for_01070_exception_code_in_query_log_table;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:38.225434 [ 2570 ] {031ae651-79ad-4e26-9b83-94381eea89df} TCPHandler: Code: 60. DB::Exception: Table test_7.test_table_for_01070_exception_code_in_query_log_table does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:38.706286 [ 3746 ] {7175bbf1-9628-4ca7-8a01-39eaeb46b3ec} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54664) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:38.712941 [ 3746 ] {7175bbf1-9628-4ca7-8a01-39eaeb46b3ec} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:38.794292 [ 2077 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:38.795290 [ 2069 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:38.795959 [ 2065 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:39.321101 [ 2844 ] {41e1c40c-b976-47ea-b58f-018adbfc814c} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51762) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:39.342043 [ 2844 ] {41e1c40c-b976-47ea-b58f-018adbfc814c} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:39.665284 [ 2213 ] {} test_w0d8q3ry.tableOut (88b6b125-298e-4357-9233-56dc4a9b84de): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 86. DB::HTTPException: Received error from remote server /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02916%2Ftest_w0d8q3ry%2Ftable%2Freplicas%2F1&part=all_1_1_0&client_protocol_version=8&compress=false&remote_fs_metadata=s3. HTTP status code: 500 Internal Server Error, body: Code: 236. DB::Exception: Could not exchange part all_1_1_0 as it's in preActive state (1000 ms) and it uses zero copy replication. This is expected behaviour and the client will retry fetching the part automatically. (ABORTED) (version 23.8.16.42.altinitystable (altinity build)). (RECEIVED_ERROR_FROM_REMOTE_IO_SERVER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String const&, int&&, String const&, String const&) @ 0x000000001dd06a80 in /usr/bin/clickhouse 3. ./build_docker/./src/IO/HTTPCommon.cpp:418: DB::HTTPException::HTTPException(int, String const&, Poco::Net::HTTPResponse::HTTPStatus, String const&, String const&) @ 0x000000001dd063ad in /usr/bin/clickhouse 4. ./build_docker/./src/IO/HTTPCommon.cpp:407: DB::assertResponseIsOk(Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, std::basic_istream>&, bool) @ 0x000000001dcfa4d1 in /usr/bin/clickhouse 5. ./build_docker/./src/IO/HTTPCommon.cpp:386: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa115 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 7. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 10. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 24. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:39.796496 [ 2089 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:39.797252 [ 2070 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:39.798922 [ 2080 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:39.880810 [ 3749 ] {3ea38186-f87c-4aa3-be0f-77da76b15d59} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51802) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:39.895887 [ 3749 ] {3ea38186-f87c-4aa3-be0f-77da76b15d59} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:40.347670 [ 3749 ] {46ae7099-c424-4c5d-a014-aba1685c2c7c} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51828) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:40.353864 [ 3749 ] {46ae7099-c424-4c5d-a014-aba1685c2c7c} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:40.799233 [ 2099 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:40.799262 [ 2095 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:40.801382 [ 2092 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:40.804039 [ 3749 ] {127b891f-f9fe-4455-a953-251a8428cefd} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51840) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:40.823875 [ 3749 ] {127b891f-f9fe-4455-a953-251a8428cefd} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:41.363433 [ 3749 ] {fa759658-368d-417c-83ef-1f65b9e80db2} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51846) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:41.377873 [ 3749 ] {fa759658-368d-417c-83ef-1f65b9e80db2} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:41.796513 [ 2216 ] {} test_w0d8q3ry.tableOut (88b6b125-298e-4357-9233-56dc4a9b84de): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 86. DB::HTTPException: Received error from remote server /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02916%2Ftest_w0d8q3ry%2Ftable%2Freplicas%2F1&part=all_1_1_0&client_protocol_version=8&compress=false&remote_fs_metadata=s3. HTTP status code: 500 Internal Server Error, body: Code: 236. DB::Exception: Could not exchange part all_1_1_0 as it's in preActive state (1000 ms) and it uses zero copy replication. This is expected behaviour and the client will retry fetching the part automatically. (ABORTED) (version 23.8.16.42.altinitystable (altinity build)). (RECEIVED_ERROR_FROM_REMOTE_IO_SERVER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String const&, int&&, String const&, String const&) @ 0x000000001dd06a80 in /usr/bin/clickhouse 3. ./build_docker/./src/IO/HTTPCommon.cpp:418: DB::HTTPException::HTTPException(int, String const&, Poco::Net::HTTPResponse::HTTPStatus, String const&, String const&) @ 0x000000001dd063ad in /usr/bin/clickhouse 4. ./build_docker/./src/IO/HTTPCommon.cpp:407: DB::assertResponseIsOk(Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, std::basic_istream>&, bool) @ 0x000000001dcfa4d1 in /usr/bin/clickhouse 5. ./build_docker/./src/IO/HTTPCommon.cpp:386: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa115 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 7. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 10. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 24. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:41.805220 [ 2056 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:41.812598 [ 1995 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:41.812823 [ 2105 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:41.837767 [ 3749 ] {02b8e174-cd15-4de2-8541-09566727d2a4} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51858) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:41.851302 [ 3749 ] {02b8e174-cd15-4de2-8541-09566727d2a4} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:42.312298 [ 3749 ] {0847e3c5-c323-4a84-a301-6045ce0a3159} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51876) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:42.323491 [ 3749 ] {0847e3c5-c323-4a84-a301-6045ce0a3159} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:42.806838 [ 2005 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:42.818478 [ 2014 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:42.819296 [ 2010 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:42.847394 [ 2694 ] {a0305085-33ff-4eb9-a1f8-5e65ff0b5475} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51888) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:42.863159 [ 2694 ] {a0305085-33ff-4eb9-a1f8-5e65ff0b5475} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:43.095836 [ 2208 ] {} test_w0d8q3ry.tableOut (88b6b125-298e-4357-9233-56dc4a9b84de): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 86. DB::HTTPException: Received error from remote server /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02916%2Ftest_w0d8q3ry%2Ftable%2Freplicas%2F1&part=all_1_1_0&client_protocol_version=8&compress=false&remote_fs_metadata=s3. HTTP status code: 500 Internal Server Error, body: Code: 236. DB::Exception: Could not exchange part all_1_1_0 as it's in preActive state (1000 ms) and it uses zero copy replication. This is expected behaviour and the client will retry fetching the part automatically. (ABORTED) (version 23.8.16.42.altinitystable (altinity build)). (RECEIVED_ERROR_FROM_REMOTE_IO_SERVER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String const&, int&&, String const&, String const&) @ 0x000000001dd06a80 in /usr/bin/clickhouse 3. ./build_docker/./src/IO/HTTPCommon.cpp:418: DB::HTTPException::HTTPException(int, String const&, Poco::Net::HTTPResponse::HTTPStatus, String const&, String const&) @ 0x000000001dd063ad in /usr/bin/clickhouse 4. ./build_docker/./src/IO/HTTPCommon.cpp:407: DB::assertResponseIsOk(Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, std::basic_istream>&, bool) @ 0x000000001dcfa4d1 in /usr/bin/clickhouse 5. ./build_docker/./src/IO/HTTPCommon.cpp:386: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa115 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 7. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 10. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 24. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:43.306219 [ 3749 ] {036bbd6f-9d43-4645-9a2c-e7e4ecf52daa} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51904) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:43.327797 [ 3749 ] {036bbd6f-9d43-4645-9a2c-e7e4ecf52daa} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:43.808814 [ 2032 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:43.820023 [ 2019 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:43.821134 [ 2042 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:43.845207 [ 3749 ] {d022c386-d9a5-4bb4-b927-0930cfd19ec2} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51920) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:43.853717 [ 3749 ] {d022c386-d9a5-4bb4-b927-0930cfd19ec2} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:44.290857 [ 3749 ] {72f3b80e-94c4-4367-9d63-ca4dd7975e14} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51924) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:44.313444 [ 3749 ] {72f3b80e-94c4-4367-9d63-ca4dd7975e14} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:44.738822 [ 3749 ] {9483e3b8-f8cf-4a6c-9d35-2917801dd1f7} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51926) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:44.743492 [ 3749 ] {9483e3b8-f8cf-4a6c-9d35-2917801dd1f7} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:44.810780 [ 2069 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:44.826777 [ 2075 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:44.827455 [ 2037 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:45.219541 [ 3749 ] {53799ca2-c759-4ebf-a794-cc59c22bd951} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51942) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:45.232260 [ 3749 ] {53799ca2-c759-4ebf-a794-cc59c22bd951} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:45.666270 [ 3749 ] {fd1d371f-e053-46e2-a20f-05ec7ace9b4c} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51952) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:45.671874 [ 3749 ] {fd1d371f-e053-46e2-a20f-05ec7ace9b4c} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:45.812371 [ 2091 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:45.828388 [ 2098 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:45.828802 [ 2097 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:46.152294 [ 3749 ] {37e68632-2257-490f-986f-2413e00bbb0c} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51960) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:46.154149 [ 3749 ] {37e68632-2257-490f-986f-2413e00bbb0c} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:46.613106 [ 3749 ] {29d455f9-9609-4c76-9326-86e9a89addcb} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51974) (comment: 02555_davengers_rename_chain.sh) (in query: SELECT * FROM wrong_metadata ORDER BY a1 FORMAT JSONEachRow), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:46.614987 [ 3749 ] {29d455f9-9609-4c76-9326-86e9a89addcb} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:46.816634 [ 1981 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:46.830320 [ 2107 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:46.831526 [ 1989 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:47.040508 [ 2611 ] {7cea0099-fd2b-4d61-a4fc-b96cdf0878c2} executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 374.47 MiB (attempt to allocate chunk of 2490368 bytes), maximum: 9.31 GiB: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46628) (comment: 00159_parallel_formatting_tsv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format TSVWithNames), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 7. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/PODArray.h:321: DB::ColumnFixedString::insertRangeFrom(DB::IColumn const&, unsigned long, unsigned long) @ 0x00000000325c3707 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:44: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeBatchImpl>(DB::SortingQueueImpl&) @ 0x0000000035b498d6 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl, DB::UUIDTag>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl, DB::SortingQueueImpl, DB::SortingQueueImpl>&>(std::__variant_detail::__visitation::__variant::__value_visitor&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl, DB::UUIDTag>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl, DB::SortingQueueImpl, DB::SortingQueueImpl>&) @ 0x0000000035a6f357 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/variant:637: DB::MergingSortedAlgorithm::merge() @ 0x0000000035a6133e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform::work() @ 0x0000000031b27a83 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 17. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:47.459248 [ 3749 ] {d1a7e7b3-cfed-4992-aded-6c7ea423ced1} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:51992) (comment: 02555_davengers_rename_chain.sh) (in query: INSERT INTO wrong_metadata VALUES ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:47.473781 [ 3749 ] {d1a7e7b3-cfed-4992-aded-6c7ea423ced1} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:47.817887 [ 1987 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:47.821585 [ 3749 ] {05da79e9-1300-4972-af6b-70969ff505da} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:52008) (comment: 02555_davengers_rename_chain.sh) (in query: SELECT * FROM wrong_metadata ORDER BY a1 FORMAT JSONEachRow), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:47.825513 [ 3749 ] {05da79e9-1300-4972-af6b-70969ff505da} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:47.835582 [ 2611 ] {7cea0099-fd2b-4d61-a4fc-b96cdf0878c2} TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 374.47 MiB (attempt to allocate chunk of 2490368 bytes), maximum: 9.31 GiB: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 7. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/PODArray.h:321: DB::ColumnFixedString::insertRangeFrom(DB::IColumn const&, unsigned long, unsigned long) @ 0x00000000325c3707 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:44: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeBatchImpl>(DB::SortingQueueImpl&) @ 0x0000000035b498d6 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl, DB::UUIDTag>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl, DB::SortingQueueImpl, DB::SortingQueueImpl>&>(std::__variant_detail::__visitation::__variant::__value_visitor&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl, DB::UUIDTag>>>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)1>, DB::SortingQueueImpl, DB::SortingQueueImpl, DB::SortingQueueImpl>&) @ 0x0000000035a6f357 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/variant:637: DB::MergingSortedAlgorithm::merge() @ 0x0000000035a6133e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform::work() @ 0x0000000031b27a83 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 17. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:47.837484 [ 1986 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:47.854139 [ 1986 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:48.316697 [ 3747 ] {abd07b6a-1f39-45d0-a67b-0d1cb3d98898} DynamicQueryHandler: Code: 271. DB::Exception: Invalid zero byte count(s): 5 and 1. (CANNOT_DECOMPRESS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, unsigned int&, unsigned int&) @ 0x000000002d0ddf21 in /usr/bin/clickhouse 3. ./build_docker/./src/Compression/CompressionCodecFPC.cpp:419: DB::CompressionCodecFPC::doDecompressData(char const*, unsigned int, char*, unsigned int) const @ 0x000000002ed1581a in /usr/bin/clickhouse 4. ./build_docker/./src/Compression/ICompressionCodec.cpp:113: DB::ICompressionCodec::decompress(char const*, unsigned int, char*) const @ 0x000000002ed28447 in /usr/bin/clickhouse 5. ./build_docker/./src/Compression/CompressedReadBufferBase.cpp:0: DB::CompressedReadBufferBase::decompress(DB::BufferBase::Buffer&, unsigned long, unsigned long) @ 0x000000002ec75cde in /usr/bin/clickhouse 6. ./build_docker/./src/Compression/CompressedReadBuffer.cpp:0: non-virtual thunk to DB::CompressedReadBuffer::nextImpl() @ 0x000000002ec70806 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/ReadBuffer.h:71: DB::(anonymous namespace)::ReadBufferWrapper::nextImpl() @ 0x000000002e5ce25b in /usr/bin/clickhouse 8. ./build_docker/./src/IO/ReadBuffer.h:72: DB::ConcatReadBuffer::nextImpl() @ 0x000000002f8bdd63 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/ReadBuffer.h:72: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f7610 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 11. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:48.489545 [ 3747 ] {2af8d64b-d90b-4941-bef4-0f19d657ba84} DynamicQueryHandler: Code: 271. DB::Exception: Invalid zero byte count(s): 1 and 6. (CANNOT_DECOMPRESS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, unsigned int&, unsigned int&) @ 0x000000002d0ddf21 in /usr/bin/clickhouse 3. ./build_docker/./src/Compression/CompressionCodecFPC.cpp:419: DB::CompressionCodecFPC::doDecompressData(char const*, unsigned int, char*, unsigned int) const @ 0x000000002ed1581a in /usr/bin/clickhouse 4. ./build_docker/./src/Compression/ICompressionCodec.cpp:113: DB::ICompressionCodec::decompress(char const*, unsigned int, char*) const @ 0x000000002ed28447 in /usr/bin/clickhouse 5. ./build_docker/./src/Compression/CompressedReadBufferBase.cpp:0: DB::CompressedReadBufferBase::decompress(DB::BufferBase::Buffer&, unsigned long, unsigned long) @ 0x000000002ec75cde in /usr/bin/clickhouse 6. ./build_docker/./src/Compression/CompressedReadBuffer.cpp:0: non-virtual thunk to DB::CompressedReadBuffer::nextImpl() @ 0x000000002ec70806 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/ReadBuffer.h:71: DB::(anonymous namespace)::ReadBufferWrapper::nextImpl() @ 0x000000002e5ce25b in /usr/bin/clickhouse 8. ./build_docker/./src/IO/ReadBuffer.h:72: DB::ConcatReadBuffer::nextImpl() @ 0x000000002f8bdd63 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/ReadBuffer.h:72: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f7610 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 11. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:48.595005 [ 2479 ] {5edcc10b-af94-4465-a34c-335ac7c51519} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:52050) (comment: 02555_davengers_rename_chain.sh) (in query: ALTER TABLE wrong_metadata RENAME COLUMN a1 TO b, RENAME COLUMN b1 to a SETTINGS replication_alter_partitions_sync = 0), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:48.598545 [ 2479 ] {5edcc10b-af94-4465-a34c-335ac7c51519} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:48.820040 [ 2029 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:48.838953 [ 1976 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:48.956529 [ 2016 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:49.822427 [ 2021 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:49.847536 [ 2034 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:49.958633 [ 2019 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:50.499285 [ 3747 ] {43e85dcf-a752-4095-988f-0bcb73913640} DynamicQueryHandler: Code: 271. DB::Exception: Cannot decompress, the number of elements in the compressed data (65) is not equal to the expected number of elements in the decompressed data (1). (CANNOT_DECOMPRESS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, unsigned long&, unsigned long&) @ 0x000000000e9ae15d in /usr/bin/clickhouse 3. ./build_docker/./src/Compression/CompressionCodecT64.cpp:584: DB::CompressionCodecT64::doDecompressData(char const*, unsigned int, char*, unsigned int) const @ 0x000000002ecc99f6 in /usr/bin/clickhouse 4. ./build_docker/./src/Compression/ICompressionCodec.cpp:113: DB::ICompressionCodec::decompress(char const*, unsigned int, char*) const @ 0x000000002ed28447 in /usr/bin/clickhouse 5. ./build_docker/./src/Compression/CompressedReadBufferBase.cpp:0: DB::CompressedReadBufferBase::decompress(DB::BufferBase::Buffer&, unsigned long, unsigned long) @ 0x000000002ec75cde in /usr/bin/clickhouse 6. ./build_docker/./src/Compression/CompressedReadBuffer.cpp:0: non-virtual thunk to DB::CompressedReadBuffer::nextImpl() @ 0x000000002ec70806 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/ReadBuffer.h:71: DB::(anonymous namespace)::ReadBufferWrapper::nextImpl() @ 0x000000002e5ce25b in /usr/bin/clickhouse 8. ./build_docker/./src/IO/ReadBuffer.h:72: DB::ConcatReadBuffer::nextImpl() @ 0x000000002f8bdd63 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/ReadBuffer.h:72: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f7610 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 11. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:50.826266 [ 2008 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:50.856383 [ 2052 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:50.961240 [ 2053 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:51.830167 [ 2076 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:51.964811 [ 2089 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:51.968768 [ 2080 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:52.731406 [ 3885 ] {13f3fe57-6a69-41a2-937b-cb68c0eb8f00} executeQuery: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42868) (comment: 02910_object-json-crash-add-column.sql) (in query: ALTER TABLE test02910 ADD COLUMN j2 Tuple(JSON) DEFAULT jString;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [114]) @ 0x000000002ede2e89 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x0000000032bfae20 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c96c in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:52.762367 [ 3885 ] {13f3fe57-6a69-41a2-937b-cb68c0eb8f00} TCPHandler: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [114]) @ 0x000000002ede2e89 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x0000000032bfae20 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c96c in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:52.832531 [ 2072 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:52.898722 [ 3885 ] {222fde53-ab74-4ddb-8d64-f0cdb267ace8} executeQuery: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42868) (comment: 02910_object-json-crash-add-column.sql) (in query: ALTER TABLE test02910 ADD COLUMN j2 Tuple(Float64, JSON);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [114]) @ 0x000000002ede2e89 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x0000000032bfae20 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c96c in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:52.904105 [ 3885 ] {222fde53-ab74-4ddb-8d64-f0cdb267ace8} TCPHandler: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [114]) @ 0x000000002ede2e89 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x0000000032bfae20 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c96c in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:52.969129 [ 2095 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:52.972721 [ 2033 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:52.996390 [ 3885 ] {afb3ca55-e1f6-4554-bd41-00bf16c95d90} executeQuery: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42868) (comment: 02910_object-json-crash-add-column.sql) (in query: ALTER TABLE test02910 ADD COLUMN j2 Tuple(Array(Tuple(JSON))) DEFAULT jString;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [114]) @ 0x000000002ede2e89 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x0000000032bfae20 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c96c in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:53.028685 [ 3885 ] {afb3ca55-e1f6-4554-bd41-00bf16c95d90} TCPHandler: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [114]) @ 0x000000002ede2e89 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x0000000032bfae20 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c96c in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:53.173029 [ 3885 ] {30a1c1ae-d3a3-45a7-b219-94ffa7174aad} executeQuery: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42868) (comment: 02910_object-json-crash-add-column.sql) (in query: ALTER TABLE test02910 ADD COLUMN j2 JSON default jString;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [114]) @ 0x000000002ede2e89 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x0000000032bfae20 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c96c in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:53.284186 [ 3885 ] {30a1c1ae-d3a3-45a7-b219-94ffa7174aad} TCPHandler: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [114]) @ 0x000000002ede2e89 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x0000000032bfae20 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c96c in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:53.834116 [ 2056 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:53.971562 [ 2105 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:53.975166 [ 1995 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:54.835773 [ 2010 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:54.973126 [ 1976 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:54.976548 [ 2028 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:55.837750 [ 2040 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:55.974571 [ 2003 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:55.977944 [ 2041 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:56.840245 [ 2067 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:56.976794 [ 2075 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:56.979719 [ 2069 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:57.847792 [ 2098 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:57.955625 [ 3885 ] {4be3024e-cff8-41c5-a871-d2481756d4c7} executeQuery: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42868) (comment: 02910_object-json-crash-add-column.sql) (in query: ALTER TABLE test02910_second ADD COLUMN `tags_json` Tuple(JSON) DEFAULT jString;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [114]) @ 0x000000002ede2e89 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x0000000032bfae20 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c96c in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:57.957158 [ 3885 ] {4be3024e-cff8-41c5-a871-d2481756d4c7} TCPHandler: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [114]) @ 0x000000002ede2e89 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x0000000032bfae20 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c96c in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:57.992302 [ 2097 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:57.992629 [ 2088 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:58.037081 [ 3885 ] {05d2d7a0-6ad6-4317-a4bf-4088a701065c} executeQuery: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42868) (comment: 02910_object-json-crash-add-column.sql) (in query: ALTER TABLE test02910_second ADD COLUMN `tags_json` Tuple(Float64, JSON);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [114]) @ 0x000000002ede2e89 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x0000000032bfae20 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c96c in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:58.066627 [ 3885 ] {05d2d7a0-6ad6-4317-a4bf-4088a701065c} TCPHandler: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [114]) @ 0x000000002ede2e89 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x0000000032bfae20 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c96c in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:58.227654 [ 3885 ] {d166a357-0e3a-4807-9042-6cd1893e4120} executeQuery: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42868) (comment: 02910_object-json-crash-add-column.sql) (in query: ALTER TABLE test02910_second ADD COLUMN `tags_json` Tuple(Array(Tuple(JSON))) DEFAULT jString;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [114]) @ 0x000000002ede2e89 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x0000000032bfae20 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c96c in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:58.231177 [ 3885 ] {d166a357-0e3a-4807-9042-6cd1893e4120} TCPHandler: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [114]) @ 0x000000002ede2e89 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x0000000032bfae20 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c96c in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:58.283840 [ 3885 ] {7541593a-a9a1-471a-9f8b-0b7917c9f5cb} executeQuery: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42868) (comment: 02910_object-json-crash-add-column.sql) (in query: ALTER TABLE test02910_second ADD COLUMN `tags_json` JSON;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [114]) @ 0x000000002ede2e89 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x0000000032bfae20 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c96c in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:58.302080 [ 3885 ] {7541593a-a9a1-471a-9f8b-0b7917c9f5cb} TCPHandler: Code: 344. DB::Exception: Adding a new column of a type which has dynamic subcolumns to an existing table is not allowed. It has known bugs. (SUPPORT_IS_DISABLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [114]) @ 0x000000002ede2e89 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/AlterCommands.cpp:0: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x0000000032bfae20 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c96c in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:26:58.856155 [ 1978 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:58.996183 [ 2107 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:58.996565 [ 1985 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:59.858836 [ 1987 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:59.997995 [ 1986 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:26:59.998439 [ 2006 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:00.862454 [ 2004 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:01.001078 [ 2015 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:01.002389 [ 2022 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:01.868162 [ 2003 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:02.002770 [ 2044 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:02.004743 [ 2046 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:02.870057 [ 2069 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:03.006624 [ 2001 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:03.016827 [ 2068 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:03.871528 [ 2088 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:04.008345 [ 2081 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:04.019751 [ 2065 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:04.288564 [ 2694 ] {ed3b5739-e2b8-4c16-9083-37f13b11c69b} executeQuery: Code: 36. DB::Exception: Dictionary attributes names must be unique. Attribute name value1 is not unique. (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59996) (comment: 01759_dictionary_unique_attribute_names.sql) (in query: CREATE DICTIONARY 01759_db.test_dictionary(key UInt64, value1 UInt64, value1 UInt64) PRIMARY KEY key SOURCE(CLICKHOUSE(HOST 'localhost' PORT tcpPort() USER 'default' TABLE 'dictionary_source_table' DB '01759_db')) LAYOUT(COMPLEX_KEY_DIRECT());), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Dictionaries/DictionaryStructure.cpp:311: DB::DictionaryStructure::getAttributes(Poco::Util::AbstractConfiguration const&, String const&, bool) @ 0x000000002d871c8c in /usr/bin/clickhouse 4. ./build_docker/./src/Dictionaries/DictionaryStructure.cpp:0: DB::DictionaryStructure::DictionaryStructure(Poco::Util::AbstractConfiguration const&, String const&) @ 0x000000002d86934d in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExternalDictionariesLoader.cpp:173: DB::ExternalDictionariesLoader::getDictionaryStructure(Poco::Util::AbstractConfiguration const&, String const&) @ 0x0000000030920e8e in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/StorageDictionary.cpp:0: DB::StorageDictionary::StorageDictionary(DB::StorageID const&, Poco::AutoPtr, std::shared_ptr) @ 0x0000000032db668f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID&, Poco::AutoPtr&, std::shared_ptr&, void>(std::allocator const&, DB::StorageID&, Poco::AutoPtr&, std::shared_ptr&) @ 0x0000000032dc2bec in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::__function::__policy_invoker (DB::StorageFactory::Arguments const&)>::__call_impl (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x0000000032dbf689 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:27:04.319218 [ 2694 ] {ed3b5739-e2b8-4c16-9083-37f13b11c69b} TCPHandler: Code: 36. DB::Exception: Dictionary attributes names must be unique. Attribute name value1 is not unique. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Dictionaries/DictionaryStructure.cpp:311: DB::DictionaryStructure::getAttributes(Poco::Util::AbstractConfiguration const&, String const&, bool) @ 0x000000002d871c8c in /usr/bin/clickhouse 4. ./build_docker/./src/Dictionaries/DictionaryStructure.cpp:0: DB::DictionaryStructure::DictionaryStructure(Poco::Util::AbstractConfiguration const&, String const&) @ 0x000000002d86934d in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ExternalDictionariesLoader.cpp:173: DB::ExternalDictionariesLoader::getDictionaryStructure(Poco::Util::AbstractConfiguration const&, String const&) @ 0x0000000030920e8e in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/StorageDictionary.cpp:0: DB::StorageDictionary::StorageDictionary(DB::StorageID const&, Poco::AutoPtr, std::shared_ptr) @ 0x0000000032db668f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID&, Poco::AutoPtr&, std::shared_ptr&, void>(std::allocator const&, DB::StorageID&, Poco::AutoPtr&, std::shared_ptr&) @ 0x0000000032dc2bec in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::__function::__policy_invoker (DB::StorageFactory::Arguments const&)>::__call_impl (DB::StorageFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::StorageFactory::Arguments const&) @ 0x0000000032dbf689 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:27:04.880997 [ 2033 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:05.011652 [ 1978 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:05.021266 [ 1977 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:05.883694 [ 2105 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:06.013809 [ 1988 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:06.023418 [ 1999 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:06.921563 [ 2014 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:06.934846 [ 2675 ] {59d073c3-3415-4a6d-baeb-cfdb65a8bb10} executeQuery: Code: 36. DB::Exception: Only `Float64` data type is allowed for the value column of GraphiteMergeTree. (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:60100) (comment: 02508_bad_graphite.sql) (in query: INSERT INTO test_graphite (key) VALUES ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [78]) @ 0x000000001d6f7109 in /usr/bin/clickhouse 3. ./build_docker/./src/Processors/Merges/Algorithms/GraphiteRollupSortedAlgorithm.cpp:36: DB::GraphiteRollupSortedAlgorithm::GraphiteRollupSortedAlgorithm(DB::Block const&, unsigned long, DB::SortDescription, unsigned long, unsigned long, DB::Graphite::Params, long) @ 0x0000000035a523be in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::GraphiteRollupSortedAlgorithm* std::construct_at[abi:v15000](DB::GraphiteRollupSortedAlgorithm*, DB::Block const&, int&&, DB::SortDescription&, unsigned long&&, int&&, DB::Graphite::Params const&, long&&) @ 0x00000000345be508 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTreeDataWriter::mergeBlock(DB::Block const&, DB::SortDescription, std::vector> const&, DB::PODArray, 63ul, 64ul>*&, DB::MergeTreeData::MergingParams const&) @ 0x00000000345a3803 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345a8c07 in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processInsertQuery() @ 0x0000000034eee177 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:503: DB::TCPHandler::runImpl() @ 0x0000000034ed6f7c in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:27:06.966192 [ 2675 ] {59d073c3-3415-4a6d-baeb-cfdb65a8bb10} TCPHandler: Code: 36. DB::Exception: Only `Float64` data type is allowed for the value column of GraphiteMergeTree. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [78]) @ 0x000000001d6f7109 in /usr/bin/clickhouse 3. ./build_docker/./src/Processors/Merges/Algorithms/GraphiteRollupSortedAlgorithm.cpp:36: DB::GraphiteRollupSortedAlgorithm::GraphiteRollupSortedAlgorithm(DB::Block const&, unsigned long, DB::SortDescription, unsigned long, unsigned long, DB::Graphite::Params, long) @ 0x0000000035a523be in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::GraphiteRollupSortedAlgorithm* std::construct_at[abi:v15000](DB::GraphiteRollupSortedAlgorithm*, DB::Block const&, int&&, DB::SortDescription&, unsigned long&&, int&&, DB::Graphite::Params const&, long&&) @ 0x00000000345be508 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTreeDataWriter::mergeBlock(DB::Block const&, DB::SortDescription, std::vector> const&, DB::PODArray, 63ul, 64ul>*&, DB::MergeTreeData::MergingParams const&) @ 0x00000000345a3803 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:951: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345a8c07 in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processInsertQuery() @ 0x0000000034eee177 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:503: DB::TCPHandler::runImpl() @ 0x0000000034ed6f7c in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:27:07.015711 [ 2028 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:07.025167 [ 2017 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:07.961760 [ 2025 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:08.017407 [ 2040 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:08.026794 [ 2035 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:09.190899 [ 2075 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:09.191721 [ 3885 ] {00251a0d-f461-4007-8795-52b4aeec6920} executeQuery: Code: 524. DB::Exception: Trying to ALTER DROP key key1 column which is a part of key expression. (ALTER_OF_COLUMN_IS_FORBIDDEN) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:60162) (comment: 01416_clear_column_pk.sql) (in query: ALTER TABLE table_with_pk_clear CLEAR COLUMN key1 IN PARTITION tuple();), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:3308: DB::MergeTreeData::checkAlterIsPossible(DB::AlterCommands const&, std::shared_ptr) const @ 0x0000000033f85540 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112ca7a in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:27:09.193822 [ 2061 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:09.190742 [ 2049 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:09.225987 [ 3885 ] {00251a0d-f461-4007-8795-52b4aeec6920} TCPHandler: Code: 524. DB::Exception: Trying to ALTER DROP key key1 column which is a part of key expression. (ALTER_OF_COLUMN_IS_FORBIDDEN), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:3308: DB::MergeTreeData::checkAlterIsPossible(DB::AlterCommands const&, std::shared_ptr) const @ 0x0000000033f85540 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112ca7a in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:27:09.842306 [ 3885 ] {7ac2fc15-7fc4-4af1-838e-4e34e83df1ca} executeQuery: Code: 524. DB::Exception: Trying to ALTER DROP key key2 column which is a part of key expression. (ALTER_OF_COLUMN_IS_FORBIDDEN) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:60162) (comment: 01416_clear_column_pk.sql) (in query: ALTER TABLE table_with_pk_clear CLEAR COLUMN key2 IN PARTITION tuple();), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:3308: DB::MergeTreeData::checkAlterIsPossible(DB::AlterCommands const&, std::shared_ptr) const @ 0x0000000033f85540 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112ca7a in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:27:09.852908 [ 3885 ] {7ac2fc15-7fc4-4af1-838e-4e34e83df1ca} TCPHandler: Code: 524. DB::Exception: Trying to ALTER DROP key key2 column which is a part of key expression. (ALTER_OF_COLUMN_IS_FORBIDDEN), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:3308: DB::MergeTreeData::checkAlterIsPossible(DB::AlterCommands const&, std::shared_ptr) const @ 0x0000000033f85540 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112ca7a in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:27:10.196672 [ 2097 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:10.197318 [ 2088 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:10.197737 [ 2081 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:11.198279 [ 1989 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:11.210252 [ 1985 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:11.210312 [ 2107 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:12.218418 [ 2006 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:12.252904 [ 1980 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:12.266240 [ 2007 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:13.021445 [ 6050 ] {0dfa7bb3-d692-44c5-a788-988319bfc538} void DB::ParallelParsingInputFormat::onBackgroundException(size_t): Code: 117. DB::ParsingException: Size of BSON document is invalid. (INCORRECT_DATA), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::ParsingException::ParsingException<>(int, FormatStringHelperImpl<>) @ 0x000000000be4f9b1 in /usr/bin/clickhouse 3. ./build_docker/./src/Processors/Formats/Impl/BSONEachRowRowInputFormat.cpp:1034: DB::fileSegmentationEngineBSONEachRow(DB::ReadBuffer&, DB::Memory>&, unsigned long, unsigned long) @ 0x00000000351b80fd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ParallelParsingInputFormat::segmentatorThreadFunction(std::shared_ptr) @ 0x0000000035460813 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl), DB::ParallelParsingInputFormat*, std::shared_ptr>(void (DB::ParallelParsingInputFormat::*&&)(std::shared_ptr), DB::ParallelParsingInputFormat*&&, std::shared_ptr&&)::'lambda'()::operator()() @ 0x000000003546c091 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:13.083235 [ 2675 ] {0dfa7bb3-d692-44c5-a788-988319bfc538} executeQuery: Code: 117. DB::ParsingException: Size of BSON document is invalid: While executing ParallelParsingBlockInputFormat. (INCORRECT_DATA) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:48828) (comment: 02589_bson_invalid_document_size.sql) (in query: select * from format(BSONEachRow, 'x UInt32', x'00000000');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::ParsingException::ParsingException<>(int, FormatStringHelperImpl<>) @ 0x000000000be4f9b1 in /usr/bin/clickhouse 3. ./build_docker/./src/Processors/Formats/Impl/BSONEachRowRowInputFormat.cpp:1034: DB::fileSegmentationEngineBSONEachRow(DB::ReadBuffer&, DB::Memory>&, unsigned long, unsigned long) @ 0x00000000351b80fd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ParallelParsingInputFormat::segmentatorThreadFunction(std::shared_ptr) @ 0x0000000035460813 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl), DB::ParallelParsingInputFormat*, std::shared_ptr>(void (DB::ParallelParsingInputFormat::*&&)(std::shared_ptr), DB::ParallelParsingInputFormat*&&, std::shared_ptr&&)::'lambda'()::operator()() @ 0x000000003546c091 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:27:13.104404 [ 2675 ] {0dfa7bb3-d692-44c5-a788-988319bfc538} TCPHandler: Code: 117. DB::ParsingException: Size of BSON document is invalid: While executing ParallelParsingBlockInputFormat. (INCORRECT_DATA), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::ParsingException::ParsingException<>(int, FormatStringHelperImpl<>) @ 0x000000000be4f9b1 in /usr/bin/clickhouse 3. ./build_docker/./src/Processors/Formats/Impl/BSONEachRowRowInputFormat.cpp:1034: DB::fileSegmentationEngineBSONEachRow(DB::ReadBuffer&, DB::Memory>&, unsigned long, unsigned long) @ 0x00000000351b80fd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::ParallelParsingInputFormat::segmentatorThreadFunction(std::shared_ptr) @ 0x0000000035460813 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl), DB::ParallelParsingInputFormat*, std::shared_ptr>(void (DB::ParallelParsingInputFormat::*&&)(std::shared_ptr), DB::ParallelParsingInputFormat*&&, std::shared_ptr&&)::'lambda'()::operator()() @ 0x000000003546c091 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:27:13.324115 [ 2016 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:13.326641 [ 2022 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:13.326931 [ 2026 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:14.369123 [ 2048 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:14.373741 [ 2052 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:14.374762 [ 2043 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:15.409855 [ 2082 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:15.410436 [ 2076 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:15.410790 [ 2070 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:16.412581 [ 2099 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:16.413388 [ 2095 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:16.413612 [ 2033 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:17.752686 [ 2086 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:17.796166 [ 1988 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:17.799252 [ 1995 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:18.765260 [ 1998 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:18.818183 [ 2005 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:18.818930 [ 2018 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:19.768070 [ 2019 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:19.820926 [ 2003 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:19.830983 [ 2042 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:23.164769 [ 2075 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:23.205446 [ 2069 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:23.703668 [ 2053 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:25.771790 [ 2092 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:25.784431 [ 2095 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:25.879814 [ 2096 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:26.828672 [ 1984 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:26.934681 [ 1988 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:26.934091 [ 1995 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:27.843578 [ 1996 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:27.938696 [ 2013 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:27.944021 [ 1998 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:28.847671 [ 2020 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:28.940901 [ 2039 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:28.946832 [ 2036 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:30.279265 [ 2050 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:30.278336 [ 2051 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:30.357078 [ 2052 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:31.516522 [ 2078 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:31.526504 [ 2088 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:31.534916 [ 2093 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:32.636432 [ 2074 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:32.637313 [ 2055 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:32.636655 [ 2091 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:33.654190 [ 1985 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:33.680049 [ 2101 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:33.682858 [ 1979 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:34.909859 [ 1987 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:34.940495 [ 2104 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:34.944571 [ 1986 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:36.167535 [ 2028 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:36.206160 [ 2017 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:36.226015 [ 2014 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:37.269841 [ 2019 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:37.418835 [ 2027 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:37.436677 [ 2015 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:38.591947 [ 2045 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:38.595231 [ 2052 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:38.595307 [ 2051 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:39.647927 [ 2061 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:39.631931 [ 2060 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:39.659264 [ 2081 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:40.831237 [ 2070 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:40.831222 [ 2097 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:40.877902 [ 2079 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:42.001605 [ 2089 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:42.016162 [ 2074 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:42.142800 [ 2055 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:43.354445 [ 1977 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:43.444967 [ 1989 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:43.464190 [ 2106 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:44.688190 [ 1990 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:44.694459 [ 1994 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:44.699075 [ 1983 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:45.807833 [ 1998 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:45.800636 [ 2005 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:45.836078 [ 2018 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:46.827059 [ 2025 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:46.965175 [ 2030 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:46.964829 [ 2021 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:47.935572 [ 2047 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:48.004921 [ 2050 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:48.009743 [ 2043 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:48.940536 [ 2001 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:49.009367 [ 2088 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:49.012342 [ 2044 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:49.951983 [ 2059 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:50.017037 [ 2065 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:50.017364 [ 2075 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:50.954883 [ 2102 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:51.022981 [ 2033 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:51.024043 [ 1978 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:51.963640 [ 1992 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:52.025513 [ 1979 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:52.026356 [ 2105 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:52.966665 [ 1988 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:53.028634 [ 1999 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:53.029161 [ 1982 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:54.116403 [ 2010 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:54.181058 [ 1998 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:54.180168 [ 1976 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:55.213939 [ 2017 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:55.215724 [ 2014 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:55.232914 [ 2004 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:56.256989 [ 2027 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:56.257469 [ 2022 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:56.257404 [ 2040 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:57.369818 [ 2038 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:57.390426 [ 2041 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:57.389656 [ 2037 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:58.388646 [ 2090 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:58.442210 [ 2061 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:58.450785 [ 2081 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:59.390403 [ 2083 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:59.461485 [ 2082 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:27:59.491584 [ 2094 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:00.494655 [ 2076 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:00.496771 [ 2089 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:00.497478 [ 2074 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:01.519434 [ 2092 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:01.521383 [ 1985 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:01.521498 [ 2101 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:02.587651 [ 2054 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:02.587995 [ 1984 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:02.593689 [ 1988 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:03.608092 [ 2010 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:03.617544 [ 1998 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:03.632826 [ 1976 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:04.618588 [ 2039 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:04.625822 [ 2025 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:04.647664 [ 2011 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:05.647402 [ 2003 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:05.648658 [ 2032 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:05.660339 [ 2042 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:06.655458 [ 2052 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:06.656362 [ 2013 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:06.663735 [ 2051 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:07.661043 [ 2061 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:07.663832 [ 2081 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:07.672241 [ 2060 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:08.713889 [ 2083 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:08.712822 [ 2097 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:08.744867 [ 2098 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:09.873378 [ 2065 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:09.876346 [ 2075 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:09.891940 [ 2069 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:10.942792 [ 2033 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:10.952368 [ 2102 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:10.979275 [ 1977 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:12.018874 [ 2105 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:12.050305 [ 1994 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:12.075492 [ 1983 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:13.078764 [ 1996 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:13.194068 [ 1986 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:13.194948 [ 2029 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:14.158820 [ 2103 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:14.196757 [ 2025 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:14.251096 [ 2039 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:15.255510 [ 2047 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:15.260345 [ 2049 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:15.357884 [ 2047 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:15.856445 [ 2487 ] {2719df82-1255-403d-bdf5-8d43c69ea8e6} executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 102.32 MiB (attempt to allocate chunk of 1114112 bytes), maximum: 9.31 GiB: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_16_16_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:52038) (comment: 00159_parallel_formatting_tsv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format TSVWithNames), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec71b39 in /usr/bin/clickhouse 8. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:122: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec79608 in /usr/bin/clickhouse 9. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f2182b0 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 25. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 28. ? @ 0x00007f11b339dac3 in ? 29. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:16.597213 [ 2068 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:16.678182 [ 2067 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:16.783708 [ 2057 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:17.840131 [ 2097 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:17.878866 [ 2082 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:18.020280 [ 2053 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:18.953096 [ 2069 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:18.956259 [ 2094 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:19.102956 [ 2089 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:19.556637 [ 2487 ] {2719df82-1255-403d-bdf5-8d43c69ea8e6} TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 102.32 MiB (attempt to allocate chunk of 1114112 bytes), maximum: 9.31 GiB: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_16_16_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec71b39 in /usr/bin/clickhouse 8. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:122: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec79608 in /usr/bin/clickhouse 9. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f2182b0 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 25. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 28. ? @ 0x00007f11b339dac3 in ? 29. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:19.974270 [ 2095 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:19.974898 [ 1989 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:20.114179 [ 2101 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:20.980725 [ 1983 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:21.079856 [ 2054 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:21.123680 [ 1984 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:22.444126 [ 2104 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:22.539919 [ 1987 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:22.618144 [ 1993 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:23.594065 [ 2016 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:23.648983 [ 2017 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:23.719801 [ 2014 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:24.527770 [ 3885 ] {34248a19-2708-430a-baa9-dfced2607eaf} executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47344) (comment: 02374_analyzer_join_using.gen.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:24.538792 [ 3885 ] {34248a19-2708-430a-baa9-dfced2607eaf} TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:24.638631 [ 2015 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:24.717676 [ 2003 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:24.748069 [ 2038 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:25.822435 [ 2051 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:25.876792 [ 2081 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:25.876777 [ 2085 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:26.016065 [ 11843 ] {ef69be35-d10f-4409-a4ee-f1a3234f1624} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.405463611 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47350) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:26.188348 [ 11843 ] {ef69be35-d10f-4409-a4ee-f1a3234f1624} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.405463611 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:26.600605 [ 3096 ] {53f3a563-67dc-474e-99c7-c202d0cadc80} executeQuery: Code: 210. DB::Exception: Unable to connect to HDFS: Hdfs::HdfsRpcException: HdfsFailoverException: Failed to invoke RPC call "getFsStats" on server "localhost:12222" Caused by: HdfsNetworkConnectException: Connect to "localhost:12222" failed: (errno: 111) Connection refused. (NETWORK_ERROR) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:48102) (comment: 02725_database_hdfs.sh) (in query: insert into table function hdfs('hdfs://localhost:12222/test_02725_2.tsv', 'TSV', 'column1 UInt32, column2 UInt32, column3 UInt32') select 4, 5, 6 settings hdfs_truncate_on_insert=1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/HDFS/HDFSCommon.cpp:176: DB::createHDFSFS(hdfsBuilder*) @ 0x000000002ddbade6 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/HDFS/StorageHDFS.cpp:0: DB::StorageHDFS::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002dd89a35 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Transforms/buildPushingToViewsChain.cpp:0: DB::buildPushingToViewsChain(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, bool, std::shared_ptr, std::shared_ptr, std::atomic*, bool, DB::Block const&) @ 0x000000003597e761 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:291: DB::InterpreterInsertQuery::buildSink(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::atomic*) @ 0x00000000314a79c7 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:534: DB::InterpreterInsertQuery::execute() @ 0x00000000314afcbd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:26.780775 [ 3096 ] {53f3a563-67dc-474e-99c7-c202d0cadc80} TCPHandler: Code: 210. DB::Exception: Unable to connect to HDFS: Hdfs::HdfsRpcException: HdfsFailoverException: Failed to invoke RPC call "getFsStats" on server "localhost:12222" Caused by: HdfsNetworkConnectException: Connect to "localhost:12222" failed: (errno: 111) Connection refused. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/HDFS/HDFSCommon.cpp:176: DB::createHDFSFS(hdfsBuilder*) @ 0x000000002ddbade6 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/HDFS/StorageHDFS.cpp:0: DB::StorageHDFS::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002dd89a35 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Transforms/buildPushingToViewsChain.cpp:0: DB::buildPushingToViewsChain(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, bool, std::shared_ptr, std::shared_ptr, std::atomic*, bool, DB::Block const&) @ 0x000000003597e761 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:291: DB::InterpreterInsertQuery::buildSink(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::atomic*) @ 0x00000000314a79c7 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:534: DB::InterpreterInsertQuery::execute() @ 0x00000000314afcbd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:26.934824 [ 2097 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:26.936922 [ 2100 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:26.937185 [ 2053 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:27.940769 [ 2084 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:27.941767 [ 2033 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:27.957241 [ 2055 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:28.945332 [ 2092 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:28.955934 [ 1985 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:28.964943 [ 1981 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:29.899860 [ 11874 ] {920b6ffb-173f-47da-82bd-acb229349f08} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.87047092 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47380) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:29.943444 [ 11874 ] {920b6ffb-173f-47da-82bd-acb229349f08} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.87047092 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:29.976135 [ 2056 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:29.979417 [ 1995 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:30.000327 [ 2002 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:30.998379 [ 2000 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:30.998627 [ 2010 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:31.002174 [ 2028 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:32.004971 [ 2025 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:32.006338 [ 2036 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:32.022288 [ 1986 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:33.012501 [ 2032 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:33.012603 [ 2042 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:33.028787 [ 2003 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:34.066703 [ 2013 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:34.066940 [ 2048 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:34.067751 [ 2077 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:35.105711 [ 2061 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:35.124312 [ 2001 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:35.152844 [ 2057 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:36.203958 [ 2098 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:36.216078 [ 2053 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:36.224345 [ 2082 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:37.310002 [ 1979 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:37.310634 [ 2075 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:37.309977 [ 2059 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:38.349190 [ 2107 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:38.357892 [ 1989 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:38.380425 [ 2106 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:39.341666 [ 11915 ] {a69273a3-aa50-4959-a0f0-3355109938c5} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 5.437732069 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57422) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:39.421372 [ 1983 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:39.440894 [ 11915 ] {a69273a3-aa50-4959-a0f0-3355109938c5} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 5.437732069 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:39.455997 [ 2054 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:39.480616 [ 2086 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:40.499157 [ 1987 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:40.541992 [ 1993 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:40.541284 [ 1980 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:41.113384 [ 7330 ] {a052599a-bd74-4dbb-8f94-51b671515b1d} DistributedSink: Structure does not match (remote: key Nullable(UInt64) Nullable(size = 0, UInt64(size = 0), UInt8(size = 0)), local: key UInt64 UInt64(size = 1)), implicit conversion will be done. 2024.10.22 00:28:41.131467 [ 11837 ] {4d5ab867-48fd-4834-8ca0-cdff4a0c3aa9} executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 1.00 MiB (attempt to allocate chunk of 1049407 bytes), maximum: 9.31 GiB. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:48176) (comment: 01278_alter_rename_combination.sql) (in query: INSERT INTO rename_table_polymorphic VALUES ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processInsertQuery() @ 0x0000000034eee177 in /usr/bin/clickhouse 31. ./build_docker/./src/Server/TCPHandler.cpp:503: DB::TCPHandler::runImpl() @ 0x0000000034ed6f7c in /usr/bin/clickhouse 2024.10.22 00:28:41.613422 [ 3740 ] {e188757d-4246-4e28-a693-02c5ea39738b} executeQuery: Code: 407. DB::Exception: Numeric overflow: While executing ConvertingAggregatedToChunksTransform. (DECIMAL_OVERFLOW) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57432) (comment: 02029_quantile_sanitizer.sql) (in query: SELECT quantileTDigestWeighted(-0.)(toDateTime(10000000000.), 1);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [17]) @ 0x000000000be2b889 in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/QuantileTDigest.h:0: unsigned int DB::QuantileTDigest::getImpl(double) @ 0x000000001ff97459 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/PODArray.h:433: DB::AggregateFunctionQuantile, DB::NameQuantileTDigestWeighted, true, void, false>::insertResultInto(char*, DB::IColumn&, DB::Arena*) const @ 0x000000002009fd55 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::insertAggregatesIntoColumns(char*&, std::vector::mutable_ptr, std::allocator::mutable_ptr>>&, DB::Arena*) const @ 0x000000002ff94eb2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::prepareBlockAndFillWithoutKey(DB::AggregatedDataVariants&, bool, bool) const @ 0x000000002fdbe88d in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:461: DB::ConvertingAggregatedToChunksTransform::initialize() @ 0x000000003575afee in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:41.617493 [ 1998 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:41.619622 [ 2036 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:41.624814 [ 3740 ] {e188757d-4246-4e28-a693-02c5ea39738b} TCPHandler: Code: 407. DB::Exception: Numeric overflow: While executing ConvertingAggregatedToChunksTransform. (DECIMAL_OVERFLOW), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [17]) @ 0x000000000be2b889 in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/QuantileTDigest.h:0: unsigned int DB::QuantileTDigest::getImpl(double) @ 0x000000001ff97459 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/PODArray.h:433: DB::AggregateFunctionQuantile, DB::NameQuantileTDigestWeighted, true, void, false>::insertResultInto(char*, DB::IColumn&, DB::Arena*) const @ 0x000000002009fd55 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::insertAggregatesIntoColumns(char*&, std::vector::mutable_ptr, std::allocator::mutable_ptr>>&, DB::Arena*) const @ 0x000000002ff94eb2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::prepareBlockAndFillWithoutKey(DB::AggregatedDataVariants&, bool, bool) const @ 0x000000002fdbe88d in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:461: DB::ConvertingAggregatedToChunksTransform::initialize() @ 0x000000003575afee in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:41.626246 [ 11837 ] {4d5ab867-48fd-4834-8ca0-cdff4a0c3aa9} TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 1.00 MiB (attempt to allocate chunk of 1049407 bytes), maximum: 9.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processInsertQuery() @ 0x0000000034eee177 in /usr/bin/clickhouse 31. ./build_docker/./src/Server/TCPHandler.cpp:503: DB::TCPHandler::runImpl() @ 0x0000000034ed6f7c in /usr/bin/clickhouse 2024.10.22 00:28:41.682628 [ 2025 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:41.983014 [ 11915 ] {034f217d-b246-4029-9b31-079031e578aa} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.814368775 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34934) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:42.066487 [ 11915 ] {034f217d-b246-4029-9b31-079031e578aa} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.814368775 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:42.676769 [ 2003 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:42.710529 [ 2038 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:42.752040 [ 2022 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:43.045845 [ 14377 ] {d119a7d5-fa34-4072-867f-e4a1812cb11b} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34986) (comment: 02555_davengers_rename_chain.sh) (in query: INSERT INTO wrong_metadata VALUES ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:43.062271 [ 14377 ] {d119a7d5-fa34-4072-867f-e4a1812cb11b} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:44.280223 [ 2081 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:44.281223 [ 2085 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:44.281316 [ 2061 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:44.290606 [ 11855 ] {ca91baa6-99fc-41d4-aebf-6d915c5aa0e5} executeQuery: Code: 43. DB::Exception: Second argument for function addSeconds (delta) must be a number. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57446) (comment: 02470_suspicious_low_cardinality_msan.sql) (in query: SELECT colAlias0, colAlias2, colAlias3 FROM alias_2__fuzz_25;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x000000000e8fe81d in /usr/bin/clickhouse 4. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000001935c3ef in /usr/bin/clickhouse 8. DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x0000000019359b41 in /usr/bin/clickhouse 9. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 10. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::defaultImplementationForNulls(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89d3bc in /usr/bin/clickhouse 13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c855 in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::updateHeader(DB::Block) const @ 0x000000002f6ae739 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transformHeader(DB::Block, DB::ActionsDAG const&) @ 0x00000000357c2c3b in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/QueryPlan/ExpressionStep.cpp:0: DB::ExpressionStep::ExpressionStep(DB::DataStream const&, std::shared_ptr const&) @ 0x0000000035c10a89 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeExpression(DB::QueryPlan&, std::shared_ptr const&, String const&) @ 0x00000000315421eb in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031528708 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:28:44.337919 [ 11855 ] {ca91baa6-99fc-41d4-aebf-6d915c5aa0e5} TCPHandler: Code: 43. DB::Exception: Second argument for function addSeconds (delta) must be a number. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x000000000e8fe81d in /usr/bin/clickhouse 4. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000001935c3ef in /usr/bin/clickhouse 8. DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x0000000019359b41 in /usr/bin/clickhouse 9. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 10. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::defaultImplementationForNulls(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89d3bc in /usr/bin/clickhouse 13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c855 in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::updateHeader(DB::Block) const @ 0x000000002f6ae739 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transformHeader(DB::Block, DB::ActionsDAG const&) @ 0x00000000357c2c3b in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/QueryPlan/ExpressionStep.cpp:0: DB::ExpressionStep::ExpressionStep(DB::DataStream const&, std::shared_ptr const&) @ 0x0000000035c10a89 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeExpression(DB::QueryPlan&, std::shared_ptr const&, String const&) @ 0x00000000315421eb in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031528708 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:28:45.286523 [ 1979 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:45.286943 [ 2067 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:45.385917 [ 2075 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:46.013360 [ 11416 ] {13044707-0291-4536-abdb-0795a63fd55c} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.719035617 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35030) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:46.081079 [ 11416 ] {13044707-0291-4536-abdb-0795a63fd55c} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.719035617 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:46.289925 [ 2106 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:46.292042 [ 1989 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:46.397093 [ 1981 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:47.293371 [ 2031 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:47.294175 [ 2002 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:47.408013 [ 2065 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:48.300658 [ 2000 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:48.301214 [ 2010 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:48.409862 [ 2006 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:49.312043 [ 11859 ] {4585deee-5d09-4bfa-bf66-bec2c0323c75} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35862) (comment: 02555_davengers_rename_chain.sh) (in query: SELECT * FROM wrong_metadata ORDER by a1 FORMAT JSONEachRow), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:49.314910 [ 2034 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:49.315485 [ 2015 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:49.406700 [ 11859 ] {4585deee-5d09-4bfa-bf66-bec2c0323c75} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:49.427417 [ 2003 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:50.319744 [ 2043 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:50.525619 [ 2013 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:50.568212 [ 2090 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:51.397747 [ 2071 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:51.595560 [ 2052 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:51.633559 [ 2082 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:52.441868 [ 2089 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:52.617630 [ 2062 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:52.697537 [ 2087 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:52.863205 [ 11418 ] {05a57d60-b1cf-48b5-8204-6e471fde6e40} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.575869925 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:36160) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:53.027895 [ 11418 ] {05a57d60-b1cf-48b5-8204-6e471fde6e40} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.575869925 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:53.570612 [ 1989 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:53.622347 [ 2092 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:53.623171 [ 11364 ] {a19f291a-ecaa-4225-a427-f24ec6701a21} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:53178) (comment: 02555_davengers_rename_chain.sh) (in query: SYSTEM SYNC REPLICA wrong_metadata), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:0: DB::InterpreterSystemQuery::syncReplica(DB::ASTSystemQuery&) @ 0x0000000031726ce9 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:583: DB::InterpreterSystemQuery::execute() @ 0x0000000031707e66 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:53.705919 [ 1981 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:54.338791 [ 11364 ] {a19f291a-ecaa-4225-a427-f24ec6701a21} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:0: DB::InterpreterSystemQuery::syncReplica(DB::ASTSystemQuery&) @ 0x0000000031726ce9 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:583: DB::InterpreterSystemQuery::execute() @ 0x0000000031707e66 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:28:54.573154 [ 1988 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:54.634129 [ 1995 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:54.715900 [ 2007 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:55.576174 [ 1976 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:55.642497 [ 2000 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:55.718067 [ 2028 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:56.580136 [ 2025 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:56.745911 [ 2021 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:56.748033 [ 2019 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:57.583706 [ 2022 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:57.754839 [ 2049 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:57.765566 [ 2041 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:58.592480 [ 2068 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:58.767948 [ 2061 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:58.768646 [ 2085 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:59.595346 [ 2052 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:59.893767 [ 2079 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:28:59.894920 [ 1979 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:00.198267 [ 11961 ] {0f266688-236c-4105-9468-290c5041edfb} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54336) (comment: 02555_davengers_rename_chain.sh) (in query: SELECT * FROM wrong_metadata order by a FORMAT JSONEachRow), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:00.260552 [ 11961 ] {0f266688-236c-4105-9468-290c5041edfb} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:00.727065 [ 2076 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:00.966848 [ 2084 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:00.987208 [ 2087 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:02.019071 [ 2096 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:02.077106 [ 2099 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:02.104240 [ 1990 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:03.222192 [ 2065 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:03.230396 [ 2007 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:03.238585 [ 2031 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:03.273391 [ 2675 ] {195bb919-fc5b-4e14-857f-27841c185bc9} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.44807717 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54338) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:03.304210 [ 2675 ] {195bb919-fc5b-4e14-857f-27841c185bc9} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.44807717 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:04.315262 [ 2028 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:04.315247 [ 2006 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:04.315485 [ 2023 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:05.358798 [ 2039 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:05.399241 [ 2019 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:05.455599 [ 2035 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:06.376470 [ 2041 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:06.402254 [ 2043 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:06.466841 [ 2013 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:06.736948 [ 11405 ] {628dc845-a4b2-445e-a0a2-092476055028} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.56560874 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:53916) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:06.746787 [ 11405 ] {628dc845-a4b2-445e-a0a2-092476055028} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.56560874 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:07.472137 [ 2088 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:07.472175 [ 2078 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:07.536562 [ 2083 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:08.694517 [ 2059 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:08.695428 [ 2045 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:08.901786 [ 2046 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:09.721243 [ 1978 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:09.721993 [ 2107 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:10.027853 [ 2095 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:10.744094 [ 2096 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:10.745386 [ 1990 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:11.053070 [ 1994 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:11.768534 [ 1995 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:11.768963 [ 1999 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:12.069680 [ 2029 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:12.774626 [ 1980 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:12.785878 [ 1976 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:13.072415 [ 2012 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:13.781843 [ 2017 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:13.791450 [ 2020 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:14.085634 [ 1998 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:14.538425 [ 11388 ] {ba4668a0-08a6-4cf8-81f3-633c3f89c63c} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:29:14.674705 [ 11388 ] {ba4668a0-08a6-4cf8-81f3-633c3f89c63c} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54648) (comment: 02555_davengers_rename_chain.sh) (in query: CREATE TABLE wrong_metadata_compact( a UInt64, b UInt64, c UInt64 ) ENGINE ReplicatedMergeTree('/test/{database}/tables/wrong_metadata_compact', '1') ORDER BY tuple() SETTINGS min_bytes_for_wide_part = 10000000), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:14.795034 [ 2030 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:14.800415 [ 2021 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:14.884197 [ 11388 ] {ba4668a0-08a6-4cf8-81f3-633c3f89c63c} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:15.092457 [ 2040 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:15.899155 [ 2022 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:15.916513 [ 2038 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:16.171813 [ 11357 ] {78b1d41c-b409-4480-b46f-a783b3ea8946} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50390) (comment: 02555_davengers_rename_chain.sh) (in query: INSERT INTO wrong_metadata_compact VALUES ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:16.170923 [ 2037 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:16.203380 [ 11357 ] {78b1d41c-b409-4480-b46f-a783b3ea8946} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:17.030905 [ 2051 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:17.066884 [ 2090 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:17.305253 [ 2058 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:17.590275 [ 11408 ] {975c907c-d00c-4138-bcbe-2d9ce0d47f9d} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.867396332 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:55074) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9,10}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:17.732140 [ 11408 ] {975c907c-d00c-4138-bcbe-2d9ce0d47f9d} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.867396332 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000002ed9b6fd in /usr/bin/clickhouse 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:110: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000002ed9a7a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcd5c in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 6. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 8. ? @ 0x00007f11b339dac3 in ? 9. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:17.993876 [ 11388 ] {c84b9ebb-26eb-4f4b-9243-56e88fff31b7} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50412) (comment: 02555_davengers_rename_chain.sh) (in query: ALTER TABLE wrong_metadata_compact RENAME COLUMN a TO a1, RENAME COLUMN b to b1 SETTINGS replication_alter_partitions_sync = 0), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:18.060486 [ 11388 ] {c84b9ebb-26eb-4f4b-9243-56e88fff31b7} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:18.086852 [ 2044 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:18.118597 [ 2085 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:18.408372 [ 2078 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:18.428459 [ 2559 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:42360). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000001dd67cf6 in /usr/bin/clickhouse 3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000001dd66139 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x0000000034ed576e in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:18.540707 [ 3731 ] {e57d3614-f987-4fcb-8f04-163379ae3415} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:36744). (NETWORK_ERROR) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:36744) (comment: 02535_max_parallel_replicas_custom_key.sh) (in query: SELECT `x` FROM `test_11`.`02535_custom_key`), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x0000000034ef05ef in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x0000000034eefbab in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:503: DB::TCPHandler::runImpl() @ 0x0000000034ed6fc7 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:18.571540 [ 3731 ] {e57d3614-f987-4fcb-8f04-163379ae3415} TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:36744). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x0000000034f12fcc in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__hash_table:1473: DB::TCPHandler::sendLogs() @ 0x0000000034ef1d88 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed8b98 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:18.576368 [ 12278 ] {2f8856f3-58c0-48ce-8388-d561748d429b} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50448) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:18.579213 [ 3731 ] {e57d3614-f987-4fcb-8f04-163379ae3415} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:36744). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProgress() @ 0x0000000034ef05ef in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x0000000034eefbab in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:503: DB::TCPHandler::runImpl() @ 0x0000000034ed6fc7 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:18.583373 [ 12278 ] {2f8856f3-58c0-48ce-8388-d561748d429b} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:18.621757 [ 3731 ] {e57d3614-f987-4fcb-8f04-163379ae3415} TCPHandler: Client has gone away. 2024.10.22 00:29:19.112192 [ 2075 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:19.166280 [ 2094 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:19.545002 [ 2046 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:20.140303 [ 2107 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:20.225434 [ 2095 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:20.651099 [ 1992 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:21.200501 [ 1982 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:21.272043 [ 2056 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:21.893830 [ 2002 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:22.292589 [ 2010 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:22.341356 [ 2006 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:22.743650 [ 11894 ] {30a68709-6232-4737-9fd8-46d89631c8a8} executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 492.96 MiB (attempt to allocate chunk of 1212544 bytes), maximum: 9.31 GiB: (avg_value_size_hint = 12.49420166015625, avg_chars_size = 5.3930419921874995, limit = 32768): (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_11_11_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47334) (comment: 00159_parallel_formatting_tsv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format TSKV), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27db01 in /usr/bin/clickhouse 8. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:22.812080 [ 11418 ] {504b379c-f134-41f4-917f-26800474c6bc} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:39320) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:22.871443 [ 11418 ] {504b379c-f134-41f4-917f-26800474c6bc} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:22.903546 [ 2020 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:23.304527 [ 2019 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:23.346639 [ 2025 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:23.913150 [ 2027 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:24.200627 [ 11894 ] {30a68709-6232-4737-9fd8-46d89631c8a8} TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 492.96 MiB (attempt to allocate chunk of 1212544 bytes), maximum: 9.31 GiB: (avg_value_size_hint = 12.49420166015625, avg_chars_size = 5.3930419921874995, limit = 32768): (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_11_11_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27db01 in /usr/bin/clickhouse 8. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:24.306917 [ 2050 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:24.359112 [ 2049 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:24.916563 [ 2013 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:25.317346 [ 2090 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:25.369578 [ 2060 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:25.945035 [ 12278 ] {a9f429a1-3c60-4978-87c3-4c5df769a780} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40230) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:25.994811 [ 12278 ] {a9f429a1-3c60-4978-87c3-4c5df769a780} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:26.005170 [ 2078 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:26.416468 [ 2053 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:26.462168 [ 2052 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:27.055287 [ 2045 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:27.116714 [ 12278 ] {15e72028-16a2-425a-b8cc-493c0cae5841} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40270) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:27.143351 [ 12278 ] {15e72028-16a2-425a-b8cc-493c0cae5841} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:27.572140 [ 2074 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:27.583800 [ 2091 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:28.159316 [ 1977 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:28.631466 [ 2107 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:28.644400 [ 11419 ] {07b7daa1-fb1b-4ded-9d29-070d2bb9029a} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40300) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:28.660626 [ 2106 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:28.740882 [ 11419 ] {07b7daa1-fb1b-4ded-9d29-070d2bb9029a} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:29.203280 [ 2105 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:29.439552 [ 3735 ] {3d5c6087-b2bc-4fac-a919-3977b4cbda9b} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:39366) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:29.459014 [ 3735 ] {3d5c6087-b2bc-4fac-a919-3977b4cbda9b} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:29.648063 [ 2054 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:29.750689 [ 1990 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:30.213162 [ 1982 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:30.667555 [ 1987 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:30.765341 [ 2005 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:31.234011 [ 2010 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:31.683040 [ 2004 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:31.814427 [ 2019 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:32.282150 [ 2034 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:32.686342 [ 2032 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:32.816451 [ 2042 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:33.203293 [ 2559 ] {a58e541a-6539-49c1-99bd-591d22aebf65} executeQuery: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got Date: While processing makeDate32(CAST(1980, 'Date'), 10). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40212) (comment: 02243_make_date32_mysql.sql) (in query: select makeDate32(cast(1980 as Date), 10);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:33.254162 [ 2559 ] {a58e541a-6539-49c1-99bd-591d22aebf65} TCPHandler: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got Date: While processing makeDate32(CAST(1980, 'Date'), 10). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:33.385751 [ 2008 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:33.727533 [ 2058 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:33.822942 [ 2057 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:34.400638 [ 2071 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:34.752436 [ 2097 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:34.825129 [ 2053 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:35.409495 [ 2079 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:35.756410 [ 2075 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:35.856442 [ 2089 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:36.413691 [ 2102 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:36.487210 [ 2559 ] {8474a3b5-29e6-413a-821c-8574a7943ff4} executeQuery: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got Date: While processing makeDate32(CAST(-1980, 'Date'), 10). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40212) (comment: 02243_make_date32_mysql.sql) (in query: select makeDate32(cast(-1980 as Date), 10);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:36.574672 [ 11375 ] {8b7fc064-2b72-42e4-9a4a-8900eae2095a} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:39918) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:36.599395 [ 2559 ] {8474a3b5-29e6-413a-821c-8574a7943ff4} TCPHandler: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got Date: While processing makeDate32(CAST(-1980, 'Date'), 10). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:36.623700 [ 11375 ] {8b7fc064-2b72-42e4-9a4a-8900eae2095a} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:36.778275 [ 2055 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:36.975209 [ 2107 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:37.345410 [ 2559 ] {1c991bf3-53ac-4d6d-ab42-a2fd138cda0a} executeQuery: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got Date32: While processing makeDate32(CAST(1980, 'Date32'), 10). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40212) (comment: 02243_make_date32_mysql.sql) (in query: select makeDate32(cast(1980 as Date32), 10);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:37.476714 [ 2559 ] {1c991bf3-53ac-4d6d-ab42-a2fd138cda0a} TCPHandler: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got Date32: While processing makeDate32(CAST(1980, 'Date32'), 10). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:37.499163 [ 2092 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:37.913255 [ 2099 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:38.040944 [ 2054 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:38.068655 [ 11894 ] {e9cc36b3-de01-48d6-8aa0-7d60a2cb64aa} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40566) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:38.131681 [ 2559 ] {899c5311-2397-404b-b94c-4931ead215ab} executeQuery: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got Date32: While processing makeDate32(CAST(-1980, 'Date32'), 10). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40212) (comment: 02243_make_date32_mysql.sql) (in query: select makeDate32(cast(-1980 as Date32), 10);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:38.157128 [ 2559 ] {899c5311-2397-404b-b94c-4931ead215ab} TCPHandler: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got Date32: While processing makeDate32(CAST(-1980, 'Date32'), 10). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:38.253157 [ 11894 ] {e9cc36b3-de01-48d6-8aa0-7d60a2cb64aa} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:38.548943 [ 1984 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:38.549691 [ 2559 ] {5f5991eb-79b5-476a-8c3a-e1a5c929e13e} executeQuery: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got DateTime: While processing makeDate32(CAST(1980, 'DateTime'), 10). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40212) (comment: 02243_make_date32_mysql.sql) (in query: select makeDate32(cast(1980 as DateTime), 10);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:38.580405 [ 2559 ] {5f5991eb-79b5-476a-8c3a-e1a5c929e13e} TCPHandler: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got DateTime: While processing makeDate32(CAST(1980, 'DateTime'), 10). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:38.849227 [ 2559 ] {cb791321-0738-4b00-a66b-fea0b6e93f83} executeQuery: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got DateTime: While processing makeDate32(CAST(-1980, 'DateTime'), 10). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40212) (comment: 02243_make_date32_mysql.sql) (in query: select makeDate32(cast(-1980 as DateTime), 10);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:38.862296 [ 2559 ] {cb791321-0738-4b00-a66b-fea0b6e93f83} TCPHandler: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got DateTime: While processing makeDate32(CAST(-1980, 'DateTime'), 10). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:39.014667 [ 1999 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:39.084988 [ 2065 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:39.312567 [ 2559 ] {73e63c01-36e0-4729-a0eb-f10be6722314} executeQuery: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got DateTime64(3): While processing makeDate32(CAST(1980, 'DateTime64'), 10). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40212) (comment: 02243_make_date32_mysql.sql) (in query: select makeDate32(cast(1980 as DateTime64), 10);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:39.365801 [ 2559 ] {73e63c01-36e0-4729-a0eb-f10be6722314} TCPHandler: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got DateTime64(3): While processing makeDate32(CAST(1980, 'DateTime64'), 10). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:39.375617 [ 2479 ] {4620ccaa-7114-4bdf-bef1-26d487b263f6} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40608) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:39.505780 [ 2479 ] {4620ccaa-7114-4bdf-bef1-26d487b263f6} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:39.650990 [ 2104 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:39.889381 [ 2559 ] {206c2ca6-e8b2-4474-91ba-7bb327119021} executeQuery: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got DateTime64(3): While processing makeDate32(CAST(-1980, 'DateTime64'), 10). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40212) (comment: 02243_make_date32_mysql.sql) (in query: select makeDate32(cast(-1980 as DateTime64), 10);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:39.931514 [ 2559 ] {206c2ca6-e8b2-4474-91ba-7bb327119021} TCPHandler: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got DateTime64(3): While processing makeDate32(CAST(-1980, 'DateTime64'), 10). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:40.037168 [ 2006 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:40.045824 [ 2559 ] {5e1bf5c8-7df1-4ac5-9c12-9e08f0132f2c} executeQuery: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got String: While processing makeDate32('1980', '10'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40212) (comment: 02243_make_date32_mysql.sql) (in query: select makeDate32('1980', '10');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:40.070010 [ 2559 ] {5e1bf5c8-7df1-4ac5-9c12-9e08f0132f2c} TCPHandler: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got String: While processing makeDate32('1980', '10'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:40.105193 [ 2016 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:40.214169 [ 3749 ] {84c66963-2d76-4911-9a3f-386b82ba541d} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43564) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:40.221137 [ 3749 ] {84c66963-2d76-4911-9a3f-386b82ba541d} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:40.352615 [ 2559 ] {7e3809d0-ad9c-4046-ba1f-739f43bffb46} executeQuery: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got String: While processing makeDate32('-1980', 3). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40212) (comment: 02243_make_date32_mysql.sql) (in query: select makeDate32('-1980', 3);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:40.401561 [ 2559 ] {7e3809d0-ad9c-4046-ba1f-739f43bffb46} TCPHandler: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got String: While processing makeDate32('-1980', 3). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:40.627794 [ 2559 ] {583955ee-abc6-478c-bd0f-5ae8c827d1df} executeQuery: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got String: While processing makeDate32('aa', 3). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40212) (comment: 02243_make_date32_mysql.sql) (in query: select makeDate32('aa', 3);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:40.657320 [ 2559 ] {583955ee-abc6-478c-bd0f-5ae8c827d1df} TCPHandler: Code: 43. DB::Exception: Illegal type of argument #1 'year' of function makeDate32, expected Number, got String: While processing makeDate32('aa', 3). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:40.665094 [ 1993 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:40.770061 [ 2559 ] {da35252e-400d-4046-8664-2864e008a70c} executeQuery: Code: 43. DB::Exception: Illegal type of argument #2 'dayofyear' of function makeDate32, expected Number, got String: While processing makeDate32(1994, 'aa'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40212) (comment: 02243_make_date32_mysql.sql) (in query: select makeDate32(1994, 'aa');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:40.784112 [ 2559 ] {da35252e-400d-4046-8664-2864e008a70c} TCPHandler: Code: 43. DB::Exception: Illegal type of argument #2 'dayofyear' of function makeDate32, expected Number, got String: While processing makeDate32(1994, 'aa'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, unsigned long&&, String&&, String&&, String&&, String&&) @ 0x000000002d8c91c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:130: DB::(anonymous namespace)::validateArgumentsImpl(DB::IFunction const&, std::vector> const&, unsigned long, std::vector> const&) @ 0x000000002d8c4305 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::validateFunctionArgumentTypes(DB::IFunction const&, std::vector> const&, std::vector> const&, std::vector> const&) @ 0x000000002d8c118a in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionMakeDate::getReturnTypeImpl(std::vector> const&) const @ 0x000000001656adb1 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:29:40.860290 [ 3749 ] {a278d05c-63fd-43d0-98c3-2a1a4e476b73} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43578) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:40.881379 [ 3749 ] {a278d05c-63fd-43d0-98c3-2a1a4e476b73} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:41.045535 [ 2011 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:41.127766 [ 2030 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:41.543389 [ 3749 ] {01ebf1e9-d561-4632-9322-04ad36902106} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43590) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:41.557384 [ 3749 ] {01ebf1e9-d561-4632-9322-04ad36902106} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:41.673931 [ 2022 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:42.051070 [ 2041 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:42.148989 [ 2077 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:42.331555 [ 3749 ] {2388d7fc-c39e-469c-9693-3fc32bdaf90f} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43598) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:42.401790 [ 3749 ] {2388d7fc-c39e-469c-9693-3fc32bdaf90f} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:42.695867 [ 2071 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:43.141003 [ 2078 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:43.208164 [ 1979 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:43.391358 [ 2479 ] {7e607814-b0eb-42a6-8473-9ab7fec7c729} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43608) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:43.419698 [ 2479 ] {7e607814-b0eb-42a6-8473-9ab7fec7c729} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:43.839294 [ 2070 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:44.172322 [ 2059 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:44.241337 [ 2076 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:44.803315 [ 2479 ] {1af16806-6292-4120-8971-7dd9501a78f8} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43630) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:44.880168 [ 2033 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:44.942478 [ 2479 ] {1af16806-6292-4120-8971-7dd9501a78f8} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:45.178252 [ 1978 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:45.245186 [ 2055 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:45.882468 [ 2105 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:46.181677 [ 1994 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:46.247995 [ 1990 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:46.884757 [ 2007 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:47.184291 [ 1996 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:47.252006 [ 2005 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:47.705085 [ 11383 ] {42dad833-bb71-4a55-9914-56d0a9a05372} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43978) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:47.757843 [ 11383 ] {42dad833-bb71-4a55-9914-56d0a9a05372} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:47.891415 [ 1976 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:48.186178 [ 2016 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:48.257507 [ 2017 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:48.982104 [ 2039 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:49.188173 [ 2025 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:49.260046 [ 2035 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:49.987416 [ 2032 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:50.190293 [ 2015 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:50.262264 [ 2022 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:50.519201 [ 11401 ] {fddf9197-8610-4f34-ab50-b7ee93ba6471} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44764) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:50.577328 [ 11401 ] {fddf9197-8610-4f34-ab50-b7ee93ba6471} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:51.083635 [ 2077 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:51.296030 [ 2060 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:51.353599 [ 2044 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:51.941545 [ 11401 ] {5521a9f5-024d-485b-a5ec-30563ddeadcd} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34364) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:52.043643 [ 11401 ] {5521a9f5-024d-485b-a5ec-30563ddeadcd} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:52.139042 [ 1979 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:52.309052 [ 2082 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:52.370705 [ 2085 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:53.155920 [ 2089 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:53.360679 [ 2062 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:53.380461 [ 2046 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:53.436792 [ 11389 ] {af037245-ed03-4b17-a75a-4242eefb609d} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34372) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:53.459290 [ 11389 ] {af037245-ed03-4b17-a75a-4242eefb609d} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:54.161257 [ 1989 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:54.367404 [ 2095 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:54.386902 [ 1985 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:55.232098 [ 2086 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:55.371689 [ 1997 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:55.389951 [ 2056 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:56.235415 [ 2009 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:56.376286 [ 2005 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:56.392283 [ 1980 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:57.240867 [ 2028 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:57.385233 [ 2026 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:57.403797 [ 2017 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:58.244242 [ 1993 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:58.388126 [ 2025 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:58.503985 [ 2011 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:58.916848 [ 11887 ] {241c33fe-9d8a-4a93-81c6-5776364a9c63} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34802) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:59.203335 [ 11887 ] {241c33fe-9d8a-4a93-81c6-5776364a9c63} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:29:59.290943 [ 2003 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:59.402600 [ 2032 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:29:59.816111 [ 2015 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:00.304664 [ 2043 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:00.728986 [ 2013 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:01.001870 [ 2058 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:01.153101 [ 3731 ] {353abadb-630d-4ad1-bcd2-1badd1f5fdbd} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54402) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:01.317206 [ 3731 ] {353abadb-630d-4ad1-bcd2-1badd1f5fdbd} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:01.734050 [ 2071 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:01.844913 [ 2066 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:02.059755 [ 2098 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:02.806936 [ 2082 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:02.895194 [ 2053 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:03.089086 [ 2079 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:03.626450 [ 11413 ] {0a72776d-47c3-4d28-8b5c-cc5cf4f1903b} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54488) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:04.085389 [ 11413 ] {0a72776d-47c3-4d28-8b5c-cc5cf4f1903b} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:04.412229 [ 2062 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:04.433110 [ 2074 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:04.438973 [ 2102 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:04.723465 [ 11413 ] {6a9934dd-b4b8-4637-a295-b6ef4d083617} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54516) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:04.787870 [ 11413 ] {6a9934dd-b4b8-4637-a295-b6ef4d083617} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:05.452868 [ 1978 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:05.455724 [ 1989 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:05.457407 [ 2107 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:05.478083 [ 11413 ] {d8194e5c-4977-4c95-9b67-a0862d1d72e6} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:54522) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:05.491232 [ 11413 ] {d8194e5c-4977-4c95-9b67-a0862d1d72e6} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:06.457268 [ 2105 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:06.461770 [ 1994 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:06.462520 [ 1990 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:07.477978 [ 1988 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:07.488153 [ 1995 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:07.574282 [ 1987 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:08.488636 [ 2010 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:08.496741 [ 2028 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:08.886226 [ 2006 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:09.532740 [ 2018 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:09.546769 [ 1986 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:09.991630 [ 1998 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:10.545004 [ 2030 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:10.557961 [ 2034 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:11.004326 [ 2015 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:11.547519 [ 2051 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:11.578495 [ 2041 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:12.107929 [ 2068 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:12.658709 [ 2088 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:12.668180 [ 2093 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:12.704735 [ 11896 ] {1a4c6bd1-033b-4033-9526-8d6ea6f3dd0e} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:55204) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:12.754902 [ 11896 ] {1a4c6bd1-033b-4033-9526-8d6ea6f3dd0e} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:13.660908 [ 2100 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:13.932047 [ 2085 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:14.024398 [ 2052 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:14.279719 [ 11896 ] {98001835-0eea-45c9-a3e4-68666042ee2d} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:60606) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:14.313123 [ 11896 ] {98001835-0eea-45c9-a3e4-68666042ee2d} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:14.879740 [ 2067 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:14.964472 [ 2062 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:15.049616 [ 2087 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:15.142842 [ 11325 ] {87f17375-43c5-494f-b8ba-02e506ad6d52} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:60614) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:15.217708 [ 11325 ] {87f17375-43c5-494f-b8ba-02e506ad6d52} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:15.905245 [ 1989 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:15.987841 [ 2055 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:16.051624 [ 11992 ] {d7cd65d5-f57e-412e-9f9c-1c5d39dcd867} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:60646) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:16.063505 [ 1985 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:16.121224 [ 11992 ] {d7cd65d5-f57e-412e-9f9c-1c5d39dcd867} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:16.917513 [ 1990 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:16.939770 [ 11992 ] {77c968f1-8ee6-4db4-bdab-0e3118aa3869} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:60648) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:16.961661 [ 11992 ] {77c968f1-8ee6-4db4-bdab-0e3118aa3869} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:16.993971 [ 2086 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:17.120233 [ 2072 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:17.887987 [ 11992 ] {f2abaaab-04b0-4f24-a413-af5fcc7435a4} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:60680) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:17.902479 [ 11992 ] {f2abaaab-04b0-4f24-a413-af5fcc7435a4} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:17.933395 [ 1982 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:18.005247 [ 1996 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:18.131452 [ 2029 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:18.935995 [ 2023 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:19.112694 [ 2016 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:19.236929 [ 2026 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:19.250303 [ 11848 ] {f6ca0bd0-dd27-456d-b273-363d0ec455fa} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:60704) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:19.276835 [ 11848 ] {f6ca0bd0-dd27-456d-b273-363d0ec455fa} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:19.938366 [ 1998 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:20.164016 [ 2039 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:20.253276 [ 2035 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:20.773769 [ 11875 ] {9bf237de-4e93-4cf6-9070-b5ba39c53add} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35982) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:20.798465 [ 11875 ] {9bf237de-4e93-4cf6-9070-b5ba39c53add} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:20.963711 [ 2003 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:21.183023 [ 2049 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:21.262688 [ 2015 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:21.975476 [ 2038 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:22.186582 [ 2044 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:22.270147 [ 2071 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:22.978233 [ 2093 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:23.218454 [ 2078 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:23.691942 [ 12172 ] {5d9f2b7b-e20a-403c-a731-5daa13538924} executeQuery: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:36300) (in query: select _path,_file from file('nonexist.txt', 'CSV', 'val1 char')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032e790ee in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/IStorage.cpp:144: DB::IStorage::read(DB::QueryPlan&, std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032cc21d9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:2486: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000031538d65 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031526e5b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:23.691750 [ 2083 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:23.754127 [ 12172 ] {5d9f2b7b-e20a-403c-a731-5daa13538924} TCPHandler: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032e790ee in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/IStorage.cpp:144: DB::IStorage::read(DB::QueryPlan&, std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032cc21d9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:2486: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000031538d65 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031526e5b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:23.997269 [ 2069 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:24.227018 [ 2076 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:24.700252 [ 2067 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:25.009600 [ 2087 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:25.229607 [ 2061 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:25.815475 [ 2095 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:26.022066 [ 2099 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:26.351535 [ 1992 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:26.482727 [ 3748 ] {f650a666-c360-4405-81bf-9acd87a19f55} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37158) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:26.587506 [ 3748 ] {f650a666-c360-4405-81bf-9acd87a19f55} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:26.989939 [ 2086 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:27.061931 [ 2072 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:27.385907 [ 1995 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:27.697814 [ 11992 ] {0423ef68-65b0-4373-90aa-6b4f1cf1e666} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37186) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:27.725791 [ 11992 ] {0423ef68-65b0-4373-90aa-6b4f1cf1e666} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:28.391728 [ 1987 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:28.427332 [ 2031 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:28.534786 [ 2104 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:28.822975 [ 11992 ] {0df5ba1b-31e4-4015-aeb4-c006a3e2db32} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37210) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:28.875750 [ 11992 ] {0df5ba1b-31e4-4015-aeb4-c006a3e2db32} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:29.475831 [ 2010 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:29.543048 [ 2006 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:29.560389 [ 2016 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:29.657533 [ 12172 ] {4eec597d-1c2e-4d02-823f-afae03b03005} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:45738) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:29.703439 [ 12172 ] {4eec597d-1c2e-4d02-823f-afae03b03005} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:30.521445 [ 2034 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:30.568572 [ 2025 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:30.574943 [ 2003 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:31.548119 [ 2050 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:31.601221 [ 2051 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:31.604714 [ 2041 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:32.552870 [ 2097 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:32.604829 [ 2079 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:32.609006 [ 2100 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:33.570859 [ 2062 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:33.610450 [ 2102 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:33.639290 [ 2091 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:34.599839 [ 2107 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:34.617082 [ 1975 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:34.662068 [ 1992 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:35.609699 [ 2105 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:35.624764 [ 1988 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:35.680266 [ 1984 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:36.226543 [ 12261 ] {5aaa0942-d44f-41ac-9e16-779837f2c955} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46612) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:36.256687 [ 12261 ] {5aaa0942-d44f-41ac-9e16-779837f2c955} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:36.628413 [ 2002 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:36.629582 [ 1990 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:36.701021 [ 2028 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:37.817261 [ 2014 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:37.812832 [ 2004 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:37.845454 [ 1986 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:37.911567 [ 11392 ] {9f800a78-7c08-440a-8be5-d4664c15411d} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46930) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:37.975806 [ 11392 ] {9f800a78-7c08-440a-8be5-d4664c15411d} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:38.883998 [ 1999 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:38.895366 [ 2040 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:38.912868 [ 2034 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:39.090626 [ 11392 ] {ca64191e-c5dc-4708-8e0b-55b9eff92401} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46938) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:39.172553 [ 11392 ] {ca64191e-c5dc-4708-8e0b-55b9eff92401} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:39.844488 [ 11438 ] {28dd0c8e-f7c5-4863-8b11-d3ed3b32f655} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56170) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:39.862827 [ 11438 ] {28dd0c8e-f7c5-4863-8b11-d3ed3b32f655} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:39.963977 [ 2013 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:39.970712 [ 2090 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:39.976872 [ 2048 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:40.388399 [ 11356 ] {8b2d15ba-31f6-499a-9db8-52e3c877ae4a} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56182) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:40.392877 [ 11356 ] {8b2d15ba-31f6-499a-9db8-52e3c877ae4a} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:40.928636 [ 11356 ] {219cd7cd-ad7e-4cbc-9660-9209a7eefebc} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56216) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:40.939330 [ 11356 ] {219cd7cd-ad7e-4cbc-9660-9209a7eefebc} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:40.966537 [ 2097 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:40.980674 [ 2079 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:40.980950 [ 2100 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:41.483330 [ 11356 ] {8d6e4926-b8d6-4d02-b4d7-8e363bbbd928} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56224) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:41.491185 [ 11356 ] {8d6e4926-b8d6-4d02-b4d7-8e363bbbd928} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:41.968429 [ 2091 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:41.985709 [ 2061 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:41.986290 [ 11875 ] {3461f83b-39af-4499-82bb-6fd63095eab4} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56246) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:41.986601 [ 1977 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:41.989050 [ 11875 ] {3461f83b-39af-4499-82bb-6fd63095eab4} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:42.597676 [ 11356 ] {a1d3cf93-aff4-4176-9eac-8d1ab2e736d7} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56260) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:42.619490 [ 11356 ] {a1d3cf93-aff4-4176-9eac-8d1ab2e736d7} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:42.665380 [ 11864 ] {0a819370-cff9-4976-b3c6-17908898a4e9} executeQuery: Code: 115. DB::Exception: Unknown setting custom_e: While processing getSetting('custom_e') AS v, toTypeName(v). (UNKNOWN_SETTING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46892) (comment: 01418_custom_settings.sql) (in query: SELECT getSetting('custom_e') as v, toTypeName(v);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Core/BaseSettings.cpp:44: DB::BaseSettingsHelpers::throwSettingNotFound(std::basic_string_view>) @ 0x000000002e694e7d in /usr/bin/clickhouse 4. DB::BaseSettings::get(std::basic_string_view>) const @ 0x0000000011cf9a16 in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionGetSetting::getValue(std::vector> const&) const @ 0x0000000011cf9050 in /usr/bin/clickhouse 6. DB::(anonymous namespace)::FunctionGetSetting::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011cf8c31 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 9. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 2024.10.22 00:30:42.674413 [ 11864 ] {0a819370-cff9-4976-b3c6-17908898a4e9} TCPHandler: Code: 115. DB::Exception: Unknown setting custom_e: While processing getSetting('custom_e') AS v, toTypeName(v). (UNKNOWN_SETTING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Core/BaseSettings.cpp:44: DB::BaseSettingsHelpers::throwSettingNotFound(std::basic_string_view>) @ 0x000000002e694e7d in /usr/bin/clickhouse 4. DB::BaseSettings::get(std::basic_string_view>) const @ 0x0000000011cf9a16 in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionGetSetting::getValue(std::vector> const&) const @ 0x0000000011cf9050 in /usr/bin/clickhouse 6. DB::(anonymous namespace)::FunctionGetSetting::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011cf8c31 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 9. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 2024.10.22 00:30:42.971678 [ 1983 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:42.995311 [ 1994 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:42.995548 [ 2101 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:43.106392 [ 11356 ] {2adf8d54-2d4e-483f-b517-9944193e4598} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56278) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:43.108969 [ 11356 ] {2adf8d54-2d4e-483f-b517-9944193e4598} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:43.264107 [ 11864 ] {3638ea0e-4a4f-47d6-872b-48139840a6c7} executeQuery: Code: 115. DB::Exception: Setting invalid_custom is neither a builtin setting nor started with the prefix 'SQL_' or 'custom_' registered for user-defined settings. (UNKNOWN_SETTING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46892) (comment: 01418_custom_settings.sql) (in query: SET invalid_custom = 8;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/AccessControl.cpp:132: DB::AccessControl::CustomSettingsPrefixes::checkSettingNameIsAllowed(std::basic_string_view>) const @ 0x000000002dfb6c6d in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d451b in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:43.268105 [ 11864 ] {3638ea0e-4a4f-47d6-872b-48139840a6c7} TCPHandler: Code: 115. DB::Exception: Setting invalid_custom is neither a builtin setting nor started with the prefix 'SQL_' or 'custom_' registered for user-defined settings. (UNKNOWN_SETTING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/AccessControl.cpp:132: DB::AccessControl::CustomSettingsPrefixes::checkSettingNameIsAllowed(std::basic_string_view>) const @ 0x000000002dfb6c6d in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:0: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d451b in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:43.423203 [ 12113 ] {70e29a9a-3d7d-42be-b8bd-2aafc8c64993} executeQuery: Code: 59. DB::Exception: Illegal type Float32 of column for filter. Must be UInt8 or Nullable(UInt8) or Const variants of them.: While executing MergeTreeInOrder. (ILLEGAL_TYPE_OF_COLUMN_FOR_FILTER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56186) (comment: 01917_prewhere_column_type.sql) (in query: SELECT s FROM t1 PREWHERE f;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Columns/FilterDescription.cpp:97: DB::FilterDescription::FilterDescription(DB::IColumn const&) @ 0x0000000032bb5dcc in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:71: DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x00000000344ad7d1 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a6189 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:43.436842 [ 12113 ] {70e29a9a-3d7d-42be-b8bd-2aafc8c64993} TCPHandler: Code: 59. DB::Exception: Illegal type Float32 of column for filter. Must be UInt8 or Nullable(UInt8) or Const variants of them.: While executing MergeTreeInOrder. (ILLEGAL_TYPE_OF_COLUMN_FOR_FILTER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Columns/FilterDescription.cpp:97: DB::FilterDescription::FilterDescription(DB::IColumn const&) @ 0x0000000032bb5dcc in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:71: DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x00000000344ad7d1 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a6189 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:43.826335 [ 12137 ] {74d799be-0a73-46bc-8617-9c7849338eee} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56314) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:43.829648 [ 12137 ] {74d799be-0a73-46bc-8617-9c7849338eee} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:43.838638 [ 12113 ] {4076d7f3-9eeb-44be-b310-3bbfb460343f} executeQuery: Code: 59. DB::Exception: Illegal type Float32 of column for filter. Must be UInt8 or Nullable(UInt8) or Const variants of them.: While executing MergeTreeInOrder. (ILLEGAL_TYPE_OF_COLUMN_FOR_FILTER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56186) (comment: 01917_prewhere_column_type.sql) (in query: SELECT s FROM t1 PREWHERE f WHERE (e = 1);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Columns/FilterDescription.cpp:97: DB::FilterDescription::FilterDescription(DB::IColumn const&) @ 0x0000000032bb5dcc in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:71: DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x00000000344ad7d1 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a6189 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:43.859634 [ 12113 ] {4076d7f3-9eeb-44be-b310-3bbfb460343f} TCPHandler: Code: 59. DB::Exception: Illegal type Float32 of column for filter. Must be UInt8 or Nullable(UInt8) or Const variants of them.: While executing MergeTreeInOrder. (ILLEGAL_TYPE_OF_COLUMN_FOR_FILTER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Columns/FilterDescription.cpp:97: DB::FilterDescription::FilterDescription(DB::IColumn const&) @ 0x0000000032bb5dcc in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:71: DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x00000000344ad7d1 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a6189 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:43.974236 [ 2031 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:43.997359 [ 2002 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:43.997972 [ 1990 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:44.115705 [ 12113 ] {845bf23e-70fe-48b4-a494-609230cda201} executeQuery: Code: 59. DB::Exception: Illegal type Float32 of column for filter. Must be UInt8 or Nullable(UInt8) or Const variants of them.: While executing MergeTreeInOrder. (ILLEGAL_TYPE_OF_COLUMN_FOR_FILTER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56186) (comment: 01917_prewhere_column_type.sql) (in query: SELECT s FROM t1 PREWHERE f WHERE f AND (e = 1);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Columns/FilterDescription.cpp:97: DB::FilterDescription::FilterDescription(DB::IColumn const&) @ 0x0000000032bb5dcc in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:71: DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x00000000344ad7d1 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a6189 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:44.117470 [ 12113 ] {845bf23e-70fe-48b4-a494-609230cda201} TCPHandler: Code: 59. DB::Exception: Illegal type Float32 of column for filter. Must be UInt8 or Nullable(UInt8) or Const variants of them.: While executing MergeTreeInOrder. (ILLEGAL_TYPE_OF_COLUMN_FOR_FILTER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Columns/FilterDescription.cpp:97: DB::FilterDescription::FilterDescription(DB::IColumn const&) @ 0x0000000032bb5dcc in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:71: DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x00000000344ad7d1 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a6189 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:44.344408 [ 12137 ] {694f223d-e21e-4883-961d-876f10adf1f8} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56334) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:44.350122 [ 12137 ] {694f223d-e21e-4883-961d-876f10adf1f8} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:44.572140 [ 12113 ] {330b7502-eade-4119-81e6-a086580ef894} executeQuery: Code: 59. DB::Exception: Illegal type UInt16 of column for filter. Must be UInt8 or Nullable(UInt8) or Const variants of them.: While executing MergeTreeInOrder. (ILLEGAL_TYPE_OF_COLUMN_FOR_FILTER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56186) (comment: 01917_prewhere_column_type.sql) (in query: SELECT s FROM t1 PREWHERE e;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Columns/FilterDescription.cpp:97: DB::FilterDescription::FilterDescription(DB::IColumn const&) @ 0x0000000032bb5dcc in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:71: DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x00000000344ad7d1 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a6189 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:44.634088 [ 12113 ] {330b7502-eade-4119-81e6-a086580ef894} TCPHandler: Code: 59. DB::Exception: Illegal type UInt16 of column for filter. Must be UInt8 or Nullable(UInt8) or Const variants of them.: While executing MergeTreeInOrder. (ILLEGAL_TYPE_OF_COLUMN_FOR_FILTER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Columns/FilterDescription.cpp:97: DB::FilterDescription::FilterDescription(DB::IColumn const&) @ 0x0000000032bb5dcc in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:71: DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x00000000344ad7d1 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a6189 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:44.824217 [ 12113 ] {b95cd598-e8cf-4e4d-85f9-12edf4770426} executeQuery: Code: 59. DB::Exception: Illegal type UInt16 of column for filter. Must be UInt8 or Nullable(UInt8) or Const variants of them.: While executing MergeTreeInOrder. (ILLEGAL_TYPE_OF_COLUMN_FOR_FILTER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56186) (comment: 01917_prewhere_column_type.sql) (in query: SELECT s FROM t1 PREWHERE e WHERE (e = 1);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Columns/FilterDescription.cpp:97: DB::FilterDescription::FilterDescription(DB::IColumn const&) @ 0x0000000032bb5dcc in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:71: DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x00000000344ad7d1 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a6189 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:44.850425 [ 12113 ] {b95cd598-e8cf-4e4d-85f9-12edf4770426} TCPHandler: Code: 59. DB::Exception: Illegal type UInt16 of column for filter. Must be UInt8 or Nullable(UInt8) or Const variants of them.: While executing MergeTreeInOrder. (ILLEGAL_TYPE_OF_COLUMN_FOR_FILTER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Columns/FilterDescription.cpp:97: DB::FilterDescription::FilterDescription(DB::IColumn const&) @ 0x0000000032bb5dcc in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:71: DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x00000000344ad7d1 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a6189 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:44.980837 [ 2019 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:44.982827 [ 12137 ] {3e98ee85-25df-48cf-9331-c1c2878e518d} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56356) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:44.989098 [ 12137 ] {3e98ee85-25df-48cf-9331-c1c2878e518d} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:45.096598 [ 2040 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:45.097466 [ 2034 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:45.309202 [ 12113 ] {e72ab19f-5818-4ae1-ab83-6fd801f93462} executeQuery: Code: 59. DB::Exception: Illegal type UInt16 of column for filter. Must be UInt8 or Nullable(UInt8) or Const variants of them.: While executing MergeTreeInOrder. (ILLEGAL_TYPE_OF_COLUMN_FOR_FILTER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56186) (comment: 01917_prewhere_column_type.sql) (in query: SELECT s FROM t1 PREWHERE e WHERE f AND (e = 1);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Columns/FilterDescription.cpp:97: DB::FilterDescription::FilterDescription(DB::IColumn const&) @ 0x0000000032bb5dcc in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:71: DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x00000000344ad7d1 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a6189 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:45.313863 [ 12113 ] {e72ab19f-5818-4ae1-ab83-6fd801f93462} TCPHandler: Code: 59. DB::Exception: Illegal type UInt16 of column for filter. Must be UInt8 or Nullable(UInt8) or Const variants of them.: While executing MergeTreeInOrder. (ILLEGAL_TYPE_OF_COLUMN_FOR_FILTER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Columns/FilterDescription.cpp:97: DB::FilterDescription::FilterDescription(DB::IColumn const&) @ 0x0000000032bb5dcc in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:71: DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x00000000344ad7d1 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a6189 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:45.404598 [ 11864 ] {73c601af-a068-4ab1-8576-50d9212172f8} executeQuery: Code: 115. DB::Exception: Unknown setting custom_f: While processing getSetting('custom_f') AS v, toTypeName(v). (UNKNOWN_SETTING) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46892) (comment: 01418_custom_settings.sql) (in query: SELECT getSetting('custom_f') as v, toTypeName(v);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Core/BaseSettings.cpp:44: DB::BaseSettingsHelpers::throwSettingNotFound(std::basic_string_view>) @ 0x000000002e694e7d in /usr/bin/clickhouse 4. DB::BaseSettings::get(std::basic_string_view>) const @ 0x0000000011cf9a16 in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionGetSetting::getValue(std::vector> const&) const @ 0x0000000011cf9050 in /usr/bin/clickhouse 6. DB::(anonymous namespace)::FunctionGetSetting::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011cf8c31 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 9. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 2024.10.22 00:30:45.436890 [ 11864 ] {73c601af-a068-4ab1-8576-50d9212172f8} TCPHandler: Code: 115. DB::Exception: Unknown setting custom_f: While processing getSetting('custom_f') AS v, toTypeName(v). (UNKNOWN_SETTING), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Core/BaseSettings.cpp:44: DB::BaseSettingsHelpers::throwSettingNotFound(std::basic_string_view>) @ 0x000000002e694e7d in /usr/bin/clickhouse 4. DB::BaseSettings::get(std::basic_string_view>) const @ 0x0000000011cf9a16 in /usr/bin/clickhouse 5. DB::(anonymous namespace)::FunctionGetSetting::getValue(std::vector> const&) const @ 0x0000000011cf9050 in /usr/bin/clickhouse 6. DB::(anonymous namespace)::FunctionGetSetting::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011cf8c31 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 9. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 2024.10.22 00:30:45.611180 [ 11356 ] {a5ab0862-956b-41e3-b3b3-0648e1db6faa} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56364) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:45.628455 [ 11356 ] {a5ab0862-956b-41e3-b3b3-0648e1db6faa} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:45.983821 [ 2041 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:46.100989 [ 2038 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:46.102118 [ 2090 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:46.575412 [ 12137 ] {d0106a2e-6ced-408b-aec8-2d64839c4c60} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56386) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:46.588450 [ 12137 ] {d0106a2e-6ced-408b-aec8-2d64839c4c60} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:47.070235 [ 2070 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:47.071720 [ 11409 ] {5a90bd13-eb5c-45a9-a2ee-36d339c6c469} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56430) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:47.086914 [ 11409 ] {5a90bd13-eb5c-45a9-a2ee-36d339c6c469} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:47.104002 [ 2069 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:47.104479 [ 2045 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:47.671828 [ 11409 ] {e88104fb-8417-4c75-86f2-03abcb0d2f78} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56464) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:47.688047 [ 11409 ] {e88104fb-8417-4c75-86f2-03abcb0d2f78} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:47.858284 [ 1910 ] {fdcad5e6-4559-4848-ae16-2dbdb24a0d96} executeQuery: Code: 306. DB::Exception: Stack size too large. Stack address: 0x7f10511b9000, frame address: 0x7f10515b8cd0, stack size: 4195120, maximum stack size: 8388608. (TOO_DEEP_RECURSION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56440) (comment: 02896_cyclic_aliases_crash.sql) (in query: SELECT val, val + 1 as prev, val + prev as val FROM ( SELECT 1 as val ) ;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, void*&, void const*&, unsigned long&, unsigned long&) @ 0x000000001d6d2dcc in /usr/bin/clickhouse 3. ./build_docker/./src/Common/checkStackSize.cpp:121: checkStackSize() @ 0x000000001d6d273a in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:78: DB::QueryNormalizer::visit(DB::ASTIdentifier&, std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fb8aae in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:286: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc2ec in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:302: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc632 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:302: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc632 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:302: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc632 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:302: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc632 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:302: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc632 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:302: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc632 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:302: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc632 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:302: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc632 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 2024.10.22 00:30:47.869771 [ 1910 ] {fdcad5e6-4559-4848-ae16-2dbdb24a0d96} TCPHandler: Code: 306. DB::Exception: Stack size too large. Stack address: 0x7f10511b9000, frame address: 0x7f10515b8cd0, stack size: 4195120, maximum stack size: 8388608. (TOO_DEEP_RECURSION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, void*&, void const*&, unsigned long&, unsigned long&) @ 0x000000001d6d2dcc in /usr/bin/clickhouse 3. ./build_docker/./src/Common/checkStackSize.cpp:121: checkStackSize() @ 0x000000001d6d273a in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:78: DB::QueryNormalizer::visit(DB::ASTIdentifier&, std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fb8aae in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:286: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc2ec in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:302: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc632 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:302: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc632 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:302: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc632 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:302: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc632 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:302: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc632 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:302: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc632 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:302: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc632 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:302: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc632 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:240: DB::QueryNormalizer::visitChildren(DB::IAST*, DB::QueryNormalizer::Data&) @ 0x0000000031fc0f9e in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/QueryNormalizer.cpp:0: DB::QueryNormalizer::visit(std::shared_ptr&, DB::QueryNormalizer::Data&) @ 0x0000000031fbc63c in /usr/bin/clickhouse 2024.10.22 00:30:48.072402 [ 2033 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:48.105459 [ 2094 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:48.106412 [ 1978 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:48.206117 [ 11356 ] {baf3ccdf-0b81-4c71-8eb3-abde691eaf60} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56478) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:48.213103 [ 11356 ] {baf3ccdf-0b81-4c71-8eb3-abde691eaf60} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:49.076002 [ 1910 ] {b816a09d-1afe-47f9-bcb6-3cea5e2f2a52} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56506) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:49.076314 [ 1983 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:49.076488 [ 11871 ] {3c1d5f72-dbc8-4e91-bb8b-a433ecd61965} executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 245.62 MiB (attempt to allocate chunk of 1248320 bytes), maximum: 9.31 GiB: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_20_20_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40246) (comment: 00159_parallel_formatting_tsv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format TSKV), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89205 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 9. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 24. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:49.089019 [ 1910 ] {b816a09d-1afe-47f9-bcb6-3cea5e2f2a52} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:49.109032 [ 2086 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:49.108970 [ 2101 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:49.852629 [ 11409 ] {9b403406-6bfd-441c-a2c5-799cd50df647} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47140) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:49.866952 [ 11409 ] {9b403406-6bfd-441c-a2c5-799cd50df647} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:50.078381 [ 2009 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:50.110560 [ 1982 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:50.111361 [ 2104 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:50.251922 [ 11356 ] {9a48917c-6ed2-4df4-aa2b-2e2db790485c} executeQuery: Code: 47. DB::Exception: Missing columns: 'value' while processing query: 'SELECT id, val, other_col FROM merge('test_9', '') WHERE value = 1048575', required columns: 'id' 'val' 'other_col' 'value', maybe you meant: 'id', 'val' or 'other_col'. (UNKNOWN_IDENTIFIER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47114) (comment: 02522_different_types_in_storage_merge.sql) (in query: SELECT * FROM merge(currentDatabase(), '') WHERE value = 1048575;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000bdd57ee in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr const&, bool, bool) @ 0x0000000031ed2df8 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edcb59 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:50.263187 [ 11356 ] {9a48917c-6ed2-4df4-aa2b-2e2db790485c} TCPHandler: Code: 47. DB::Exception: Missing columns: 'value' while processing query: 'SELECT id, val, other_col FROM merge('test_9', '') WHERE value = 1048575', required columns: 'id' 'val' 'other_col' 'value', maybe you meant: 'id', 'val' or 'other_col'. (UNKNOWN_IDENTIFIER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000bdd57ee in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr const&, bool, bool) @ 0x0000000031ed2df8 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edcb59 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:50.401159 [ 11871 ] {3c1d5f72-dbc8-4e91-bb8b-a433ecd61965} TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 245.62 MiB (attempt to allocate chunk of 1248320 bytes), maximum: 9.31 GiB: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_20_20_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89205 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 9. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 24. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:50.445335 [ 11855 ] {5a0108ff-13af-4282-92f6-7c61f3a27609} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47174) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:50.558351 [ 11855 ] {5a0108ff-13af-4282-92f6-7c61f3a27609} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:51.080235 [ 2016 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:51.113729 [ 2012 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:51.114336 [ 2036 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:51.293258 [ 12232 ] {ed7cb70c-9a62-4e14-9d82-f940cb7c28b0} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47224) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:51.303373 [ 12232 ] {ed7cb70c-9a62-4e14-9d82-f940cb7c28b0} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:51.895994 [ 11992 ] {6199a349-f955-41c5-b3c7-156d89b576ff} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47252) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:51.913540 [ 11992 ] {6199a349-f955-41c5-b3c7-156d89b576ff} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:52.081544 [ 2015 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:52.117036 [ 2047 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:52.117810 [ 2037 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:52.563775 [ 11441 ] {e48afb94-abba-4ff2-9ba4-e1ee91e61901} executeQuery: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47276) (comment: 02555_davengers_rename_chain.sh) (in query: SHOW CREATE TABLE wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:52.577837 [ 11441 ] {e48afb94-abba-4ff2-9ba4-e1ee91e61901} TCPHandler: Code: 390. DB::Exception: Table `wrong_metadata_compact` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:485: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000002f2faaa7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterShowCreateQuery::executeImpl() @ 0x00000000316f3177 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterShowCreateQuery.cpp:0: DB::InterpreterShowCreateQuery::execute() @ 0x00000000316f22ff in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:53.188888 [ 2088 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:53.189152 [ 2044 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:53.189082 [ 11441 ] {8ec2cdf6-1ebe-4150-ac50-031a767d4f4c} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47306) (comment: 02555_davengers_rename_chain.sh) (in query: SELECT * FROM wrong_metadata_compact ORDER BY a1 FORMAT JSONEachRow), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:53.189125 [ 11844 ] {53cb7e21-4b54-4c97-9743-16b9074a97ee} executeQuery: Code: 43. DB::Exception: Illegal type String of argument for aggregate function sumCount. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:60638) (comment: 02119_sumcount.sql) (in query: -- Other types SELECT toTypeName(sumCount(v)), sumCount(v) FROM (SELECT 'a'::String AS v);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String const&) @ 0x000000000e2ae076 in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionSumCount.cpp:34: DB::(anonymous namespace)::createAggregateFunctionSumCount(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::Settings const*) @ 0x00000000231c8687 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d34d3 in /usr/bin/clickhouse 5. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr&, std::vector>&) @ 0x000000002fca6e39 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr&) @ 0x000000002fc9e410 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, unsigned long, bool, bool, std::shared_ptr, bool) @ 0x000000002fc9bbd4 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:313: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, std::vector> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr) @ 0x0000000031558e9e in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x00000000315190df in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:53.189424 [ 2093 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:53.250853 [ 11844 ] {53cb7e21-4b54-4c97-9743-16b9074a97ee} TCPHandler: Code: 43. DB::Exception: Illegal type String of argument for aggregate function sumCount. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String const&) @ 0x000000000e2ae076 in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionSumCount.cpp:34: DB::(anonymous namespace)::createAggregateFunctionSumCount(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::Settings const*) @ 0x00000000231c8687 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d34d3 in /usr/bin/clickhouse 5. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr&, std::vector>&) @ 0x000000002fca6e39 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr&) @ 0x000000002fc9e410 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, unsigned long, bool, bool, std::shared_ptr, bool) @ 0x000000002fc9bbd4 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:313: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, std::vector> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr) @ 0x0000000031558e9e in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x00000000315190df in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:53.357913 [ 11441 ] {8ec2cdf6-1ebe-4150-ac50-031a767d4f4c} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:53.381397 [ 11844 ] {3b1cc25d-7dc5-4615-beea-8ffe06164388} executeQuery: Code: 43. DB::Exception: Illegal type DateTime of argument for aggregate function sumCount. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:60638) (comment: 02119_sumcount.sql) (in query: SELECT toTypeName(sumCount(v)), sumCount(v) FROM (SELECT now()::DateTime AS v);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String const&) @ 0x000000000e2ae076 in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionSumCount.cpp:34: DB::(anonymous namespace)::createAggregateFunctionSumCount(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::Settings const*) @ 0x00000000231c8687 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d34d3 in /usr/bin/clickhouse 5. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr&, std::vector>&) @ 0x000000002fca6e39 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr&) @ 0x000000002fc9e410 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, unsigned long, bool, bool, std::shared_ptr, bool) @ 0x000000002fc9bbd4 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:313: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, std::vector> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr) @ 0x0000000031558e9e in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x00000000315190df in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:53.392904 [ 11844 ] {3b1cc25d-7dc5-4615-beea-8ffe06164388} TCPHandler: Code: 43. DB::Exception: Illegal type DateTime of argument for aggregate function sumCount. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String const&) @ 0x000000000e2ae076 in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionSumCount.cpp:34: DB::(anonymous namespace)::createAggregateFunctionSumCount(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::Settings const*) @ 0x00000000231c8687 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d34d3 in /usr/bin/clickhouse 5. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr&, std::vector>&) @ 0x000000002fca6e39 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr&) @ 0x000000002fc9e410 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, unsigned long, bool, bool, std::shared_ptr, bool) @ 0x000000002fc9bbd4 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:313: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, std::vector> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr) @ 0x0000000031558e9e in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x00000000315190df in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:54.160855 [ 11861 ] {d3d8206f-d7d2-4f02-a242-d865904ef071} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47360) (comment: 02555_davengers_rename_chain.sh) (in query: INSERT INTO wrong_metadata_compact VALUES ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:54.168472 [ 11861 ] {d3d8206f-d7d2-4f02-a242-d865904ef071} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:54.250215 [ 2097 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:54.254278 [ 2083 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:54.254105 [ 2085 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:54.565172 [ 11382 ] {612de9a7-0646-4447-b935-cc52095e7699} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47368) (comment: 02555_davengers_rename_chain.sh) (in query: SELECT * FROM wrong_metadata_compact ORDER BY a1 FORMAT JSONEachRow), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:54.573000 [ 11382 ] {612de9a7-0646-4447-b935-cc52095e7699} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:55.253678 [ 1989 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:55.257019 [ 2095 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:55.257026 [ 2055 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:55.348128 [ 11874 ] {67ece3fb-cfa8-49aa-ae95-fd3657041b58} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47424) (comment: 02555_davengers_rename_chain.sh) (in query: ALTER TABLE wrong_metadata_compact RENAME COLUMN a1 TO b, RENAME COLUMN b1 to a SETTINGS replication_alter_partitions_sync = 0), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:55.371771 [ 11874 ] {67ece3fb-cfa8-49aa-ae95-fd3657041b58} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:56.255528 [ 2086 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:56.258649 [ 2072 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:56.259536 [ 1997 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:57.302058 [ 11874 ] {53cad17c-b3a1-4428-a6b7-68d5b1dcca63} executeQuery: Code: 36. DB::Exception: Tables have different secondary indices. (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47446) (comment: 02888_attach_partition_from_different_tables.sql) (in query: ALTER TABLE attach_partition_t2 ATTACH PARTITION tuple() FROM attach_partition_t1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [40]) @ 0x000000000bdcfca9 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::checkStructureAndGetMergeTreeData(DB::IStorage&, std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000003403254b in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageMergeTree.cpp:0: DB::StorageMergeTree::replacePartitionFrom(std::shared_ptr const&, std::shared_ptr const&, bool, std::shared_ptr) @ 0x000000003494eb33 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeData::alterPartition(std::shared_ptr const&, std::vector> const&, std::shared_ptr) @ 0x0000000033fd50ff in /usr/bin/clickhouse 6. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c16c in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:57.302283 [ 2010 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:57.302324 [ 2023 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:57.302207 [ 1980 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:57.313007 [ 11874 ] {53cad17c-b3a1-4428-a6b7-68d5b1dcca63} TCPHandler: Code: 36. DB::Exception: Tables have different secondary indices. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [40]) @ 0x000000000bdcfca9 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::checkStructureAndGetMergeTreeData(DB::IStorage&, std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000003403254b in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageMergeTree.cpp:0: DB::StorageMergeTree::replacePartitionFrom(std::shared_ptr const&, std::shared_ptr const&, bool, std::shared_ptr) @ 0x000000003494eb33 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeData::alterPartition(std::shared_ptr const&, std::vector> const&, std::shared_ptr) @ 0x0000000033fd50ff in /usr/bin/clickhouse 6. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c16c in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:30:58.305323 [ 2011 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:58.306156 [ 2103 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:58.307093 [ 2011 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:59.307071 [ 2041 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:59.308474 [ 2090 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:30:59.309578 [ 2038 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:00.309035 [ 2069 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:00.310005 [ 2045 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:00.311695 [ 2080 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:01.365947 [ 2092 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:01.366506 [ 2084 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:01.368055 [ 2074 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:02.442909 [ 2059 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:02.443932 [ 2056 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:02.444635 [ 2007 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:02.900111 [ 11874 ] {f81d1278-cb05-41f8-9b49-5168818d98c3} executeQuery: Code: 36. DB::Exception: Tables have different projections. (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47446) (comment: 02888_attach_partition_from_different_tables.sql) (in query: ALTER TABLE attach_partition_t4 ATTACH PARTITION tuple() FROM attach_partition_t3;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [34]) @ 0x000000000cd42ac9 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::checkStructureAndGetMergeTreeData(DB::IStorage&, std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000003403258b in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageMergeTree.cpp:0: DB::StorageMergeTree::replacePartitionFrom(std::shared_ptr const&, std::shared_ptr const&, bool, std::shared_ptr) @ 0x000000003494eb33 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeData::alterPartition(std::shared_ptr const&, std::vector> const&, std::shared_ptr) @ 0x0000000033fd50ff in /usr/bin/clickhouse 6. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c16c in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:02.938950 [ 11874 ] {f81d1278-cb05-41f8-9b49-5168818d98c3} TCPHandler: Code: 36. DB::Exception: Tables have different projections. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [34]) @ 0x000000000cd42ac9 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::checkStructureAndGetMergeTreeData(DB::IStorage&, std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000003403258b in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageMergeTree.cpp:0: DB::StorageMergeTree::replacePartitionFrom(std::shared_ptr const&, std::shared_ptr const&, bool, std::shared_ptr) @ 0x000000003494eb33 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeData::alterPartition(std::shared_ptr const&, std::vector> const&, std::shared_ptr) @ 0x0000000033fd50ff in /usr/bin/clickhouse 6. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c16c in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:03.448134 [ 2018 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:03.449386 [ 2004 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:03.450223 [ 2018 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:04.449753 [ 2051 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:04.453210 [ 2003 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:04.454245 [ 2048 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:05.451621 [ 2014 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:05.454910 [ 2070 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:05.456489 [ 2045 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:06.453193 [ 2107 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:06.456586 [ 1975 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:06.458124 [ 1992 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:07.455434 [ 1984 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:07.460370 [ 1982 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:07.464038 [ 1984 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:08.460248 [ 2039 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:08.468144 [ 2035 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:08.471879 [ 2103 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:09.462890 [ 2015 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:09.476273 [ 2047 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:09.491312 [ 2037 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:10.670867 [ 2088 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:10.670392 [ 2053 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:10.669930 [ 11408 ] {bda9dfa1-b9f4-4388-a1c5-81446e72abcf} executeQuery: Code: 284. DB::Exception: Global subquery requires subquery or table name: While processing (NULL, cityHash64(0., 65536, NULL, NULL, 10000000000., NULL), 0) GLOBAL IN (some_identifier). (WRONG_GLOBAL_SUBQUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35074) (comment: 02002_global_subqueries_subquery_or_table_name.sql) (in query: SELECT cityHash64(number GLOBAL IN (NULL, -2147483648, -9223372036854775808), nan, 1024, NULL, NULL, 1.000100016593933, NULL), (NULL, cityHash64(inf, -2147483648, NULL, NULL, 10.000100135803223), cityHash64(1.1754943508222875e-38, NULL, NULL, NULL), 2147483647) FROM cluster(test_cluster_two_shards_localhost, numbers((NULL, cityHash64(0., 65536, NULL, NULL, 10000000000., NULL), 0) GLOBAL IN (some_identifier), 65536)) WHERE number GLOBAL IN [1025] --{serverError 36, 284} ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [48]) @ 0x000000000cd3ad09 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/GlobalSubqueriesVisitor.h:100: DB::GlobalSubqueriesMatcher::Data::addExternalStorage(std::shared_ptr&, std::vector> const&, bool) @ 0x000000002fd016b9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::GlobalSubqueriesMatcher::visit(DB::ASTFunction&, std::shared_ptr&, DB::GlobalSubqueriesMatcher::Data&) @ 0x000000002fcfc14b in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::InDepthNodeVisitor>::doVisit(std::shared_ptr&) @ 0x000000002fcfb6df in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000002fd040ef in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000002fd040e4 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000002fd040e4 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000002fd040e4 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000002fd040e4 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000002fd040e4 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000002fd040e4 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000002fd040e4 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:61: DB::ExpressionAnalyzer::initGlobalSubqueriesAndExternalTables(bool, bool) @ 0x000000002fc9c9a6 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, unsigned long, bool, bool, std::shared_ptr, bool) @ 0x000000002fc9b789 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:313: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, std::vector> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr) @ 0x0000000031558e9e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x00000000315190df in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:31:10.670122 [ 2093 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:10.679543 [ 11408 ] {bda9dfa1-b9f4-4388-a1c5-81446e72abcf} TCPHandler: Code: 284. DB::Exception: Global subquery requires subquery or table name: While processing (NULL, cityHash64(0., 65536, NULL, NULL, 10000000000., NULL), 0) GLOBAL IN (some_identifier). (WRONG_GLOBAL_SUBQUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [48]) @ 0x000000000cd3ad09 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/GlobalSubqueriesVisitor.h:100: DB::GlobalSubqueriesMatcher::Data::addExternalStorage(std::shared_ptr&, std::vector> const&, bool) @ 0x000000002fd016b9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::GlobalSubqueriesMatcher::visit(DB::ASTFunction&, std::shared_ptr&, DB::GlobalSubqueriesMatcher::Data&) @ 0x000000002fcfc14b in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::InDepthNodeVisitor>::doVisit(std::shared_ptr&) @ 0x000000002fcfb6df in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:0: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000002fd040ef in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000002fd040e4 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000002fd040e4 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000002fd040e4 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000002fd040e4 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000002fd040e4 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000002fd040e4 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000002fd040e4 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:61: DB::ExpressionAnalyzer::initGlobalSubqueriesAndExternalTables(bool, bool) @ 0x000000002fc9c9a6 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, unsigned long, bool, bool, std::shared_ptr, bool) @ 0x000000002fc9b789 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:313: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, std::vector> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr) @ 0x0000000031558e9e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x00000000315190df in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:31:11.019205 [ 11855 ] {b7b67c7d-8e3e-41b2-a75b-65b15528fa2c} executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 33.15 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47232) (comment: 00032_aggregate_key64.sql) (in query: SELECT SearchEngineID AS k1, count() AS c FROM test.hits GROUP BY k1 ORDER BY c DESC, k1 LIMIT 10 ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:11.599165 [ 11855 ] {b7b67c7d-8e3e-41b2-a75b-65b15528fa2c} TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 33.15 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:11.672781 [ 2085 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:11.673205 [ 2089 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:11.673985 [ 2082 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:12.680902 [ 1978 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:12.680625 [ 2094 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:12.681530 [ 1989 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:13.221394 [ 2559 ] {d6487d15-e2f7-4a64-bbcb-5b637275b9a5} executeQuery: Code: 43. DB::Exception: First argument for function tupleElement must be tuple or array of tuple. Actual Int8: While processing tupleElement(CAST(1, 'Int8'), sumState(0)). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT tupleElement(CAST(1 AS Int8),sumState(0));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionTupleElement::getReturnTypeImpl(std::vector> const&) const @ 0x000000001ae7e30a in /usr/bin/clickhouse 4. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:31:13.233894 [ 2559 ] {d6487d15-e2f7-4a64-bbcb-5b637275b9a5} TCPHandler: Code: 43. DB::Exception: First argument for function tupleElement must be tuple or array of tuple. Actual Int8: While processing tupleElement(CAST(1, 'Int8'), sumState(0)). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionTupleElement::getReturnTypeImpl(std::vector> const&) const @ 0x000000001ae7e30a in /usr/bin/clickhouse 4. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:31:13.682714 [ 1994 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:13.683452 [ 2095 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:13.684007 [ 2101 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:14.279987 [ 11419 ] {e7b82506-8cd4-4b49-bf3c-7093d446f3fb} PostgreSQLConnectionPool: Connection error: connection to server at "127.121.0.1", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? 2024.10.22 00:31:14.284189 [ 11419 ] {e7b82506-8cd4-4b49-bf3c-7093d446f3fb} PostgreSQLConnectionPool: Connection error: connection to server at "127.121.0.1", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? 2024.10.22 00:31:14.287595 [ 11419 ] {e7b82506-8cd4-4b49-bf3c-7093d446f3fb} PostgreSQLConnectionPool: Connection error: connection to server at "127.121.0.1", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? 2024.10.22 00:31:14.289741 [ 11419 ] {e7b82506-8cd4-4b49-bf3c-7093d446f3fb} PostgreSQLConnectionPool: Connection error: connection to server at "127.121.0.1", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? 2024.10.22 00:31:14.291171 [ 11419 ] {e7b82506-8cd4-4b49-bf3c-7093d446f3fb} PostgreSQLConnectionPool: Connection error: connection to server at "127.121.0.1", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? 2024.10.22 00:31:14.370120 [ 11419 ] {e7b82506-8cd4-4b49-bf3c-7093d446f3fb} executeQuery: Code: 614. DB::Exception: Try 5. Connection to `127.121.0.1:5432` failed with error: connection to server at "127.121.0.1", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? . (POSTGRESQL_CONNECTION_FAILURE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35168) (comment: 02888_system_tables_with_inaccsessible_table_function.sql) (in query: CREATE TABLE test_72mhg120.tablefunc01_without_schema AS postgresql('127.121.0.1:5432', 'postgres_db', 'postgres_table', 'postgres_user', '[HIDDEN]')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(PreformattedMessage const&, int) @ 0x000000002d0fee8e in /usr/bin/clickhouse 3. ./build_docker/./src/Core/PostgreSQL/PoolWithFailover.cpp:135: postgres::PoolWithFailover::get() @ 0x000000002dc9283e in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StoragePostgreSQL.cpp:0: DB::StoragePostgreSQL::getTableStructureFromData(std::shared_ptr const&, String const&, String const&, std::shared_ptr const&) @ 0x00000000330cafa4 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TableFunctionPostgreSQL::getActualTableStructure(std::shared_ptr, bool) const @ 0x000000002d1e0e78 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x0000000030f403e5 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f50859 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:14.391896 [ 11419 ] {e7b82506-8cd4-4b49-bf3c-7093d446f3fb} TCPHandler: Code: 614. DB::Exception: Try 5. Connection to `127.121.0.1:5432` failed with error: connection to server at "127.121.0.1", port 5432 failed: Connection refused Is the server running on that host and accepting TCP/IP connections? . (POSTGRESQL_CONNECTION_FAILURE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(PreformattedMessage const&, int) @ 0x000000002d0fee8e in /usr/bin/clickhouse 3. ./build_docker/./src/Core/PostgreSQL/PoolWithFailover.cpp:135: postgres::PoolWithFailover::get() @ 0x000000002dc9283e in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StoragePostgreSQL.cpp:0: DB::StoragePostgreSQL::getTableStructureFromData(std::shared_ptr const&, String const&, String const&, std::shared_ptr const&) @ 0x00000000330cafa4 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TableFunctionPostgreSQL::getActualTableStructure(std::shared_ptr, bool) const @ 0x000000002d1e0e78 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x0000000030f403e5 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f50859 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:14.457827 [ 11419 ] {1eff7a08-8b16-4c0a-8c53-5d1e8e45e1eb} mysqlxx::Pool: mysqlxx::ConnectionFailed 2024.10.22 00:31:14.458659 [ 11419 ] {1eff7a08-8b16-4c0a-8c53-5d1e8e45e1eb} Application: Connection to mysql_db@127.123.0.1:3306 as user mysql_user failed: mysqlxx::ConnectionFailed: Can't connect to MySQL server on '127.123.0.1' (115) ((nullptr):0) 2024.10.22 00:31:14.459411 [ 11419 ] {1eff7a08-8b16-4c0a-8c53-5d1e8e45e1eb} Application: Connection to mysql failed 1 times 2024.10.22 00:31:14.465915 [ 11419 ] {1eff7a08-8b16-4c0a-8c53-5d1e8e45e1eb} mysqlxx::Pool: mysqlxx::ConnectionFailed 2024.10.22 00:31:14.466850 [ 11419 ] {1eff7a08-8b16-4c0a-8c53-5d1e8e45e1eb} Application: Connection to mysql_db@127.123.0.1:3306 as user mysql_user failed: mysqlxx::ConnectionFailed: Can't connect to MySQL server on '127.123.0.1' (115) ((nullptr):0) 2024.10.22 00:31:14.469179 [ 11419 ] {1eff7a08-8b16-4c0a-8c53-5d1e8e45e1eb} Application: Connection to mysql failed 2 times 2024.10.22 00:31:14.474758 [ 11419 ] {1eff7a08-8b16-4c0a-8c53-5d1e8e45e1eb} mysqlxx::Pool: mysqlxx::ConnectionFailed 2024.10.22 00:31:14.476747 [ 11419 ] {1eff7a08-8b16-4c0a-8c53-5d1e8e45e1eb} Application: Connection to mysql_db@127.123.0.1:3306 as user mysql_user failed: mysqlxx::ConnectionFailed: Can't connect to MySQL server on '127.123.0.1' (115) ((nullptr):0) 2024.10.22 00:31:14.477553 [ 11419 ] {1eff7a08-8b16-4c0a-8c53-5d1e8e45e1eb} Application: Connection to mysql failed 3 times 2024.10.22 00:31:14.651269 [ 11419 ] {1eff7a08-8b16-4c0a-8c53-5d1e8e45e1eb} executeQuery: Poco::Exception. Code: 1000, e.code() = 0, Exception: Connections to mysql failed: mysql_db@127.123.0.1:3306 as user mysql_user, ERROR 2002 : mysqlxx::ConnectionFailed: Can't connect to MySQL server on '127.123.0.1' (115) ((nullptr):0) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35168) (comment: 02888_system_tables_with_inaccsessible_table_function.sql) (in query: CREATE TABLE test_72mhg120.tablefunc02_without_schema AS mysql('127.123.0.1:3306', 'mysql_db', 'mysql_table', 'mysql_user', '[HIDDEN]')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/mysqlxx/PoolWithFailover.cpp:214: mysqlxx::PoolWithFailover::get() @ 0x000000003db8cd21 in /usr/bin/clickhouse 2. ./build_docker/./src/Databases/MySQL/FetchTablesColumnsList.cpp:0: DB::fetchTablesColumnsList(mysqlxx::PoolWithFailover&, String const&, std::vector> const&, DB::Settings const&, MultiEnum) @ 0x000000003106c3c8 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageMySQL.cpp:0: DB::StorageMySQL::getTableStructureFromData(mysqlxx::PoolWithFailover&, String const&, String const&, std::shared_ptr const&) @ 0x00000000330b40b6 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TableFunctionMySQL::getActualTableStructure(std::shared_ptr, bool) const @ 0x000000002d1dc878 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x0000000030f403e5 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f50859 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:14.684815 [ 1982 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:14.685531 [ 1984 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:14.686028 [ 2081 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:14.728089 [ 11419 ] {1eff7a08-8b16-4c0a-8c53-5d1e8e45e1eb} TCPHandler: Code: 1000. DB::Exception: Exception: Connections to mysql failed: mysql_db@127.123.0.1:3306 as user mysql_user, ERROR 2002 : mysqlxx::ConnectionFailed: Can't connect to MySQL server on '127.123.0.1' (115) ((nullptr):0). (POCO_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/mysqlxx/PoolWithFailover.cpp:214: mysqlxx::PoolWithFailover::get() @ 0x000000003db8cd21 in /usr/bin/clickhouse 2. ./build_docker/./src/Databases/MySQL/FetchTablesColumnsList.cpp:0: DB::fetchTablesColumnsList(mysqlxx::PoolWithFailover&, String const&, std::vector> const&, DB::Settings const&, MultiEnum) @ 0x000000003106c3c8 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageMySQL.cpp:0: DB::StorageMySQL::getTableStructureFromData(mysqlxx::PoolWithFailover&, String const&, String const&, std::shared_ptr const&) @ 0x00000000330b40b6 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::TableFunctionMySQL::getActualTableStructure(std::shared_ptr, bool) const @ 0x000000002d1dc878 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x0000000030f403e5 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f50859 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:15.590756 [ 2559 ] {42eedcc4-4b07-437d-8ce0-eda5a203e17c} executeQuery: Code: 43. DB::Exception: Illegal type (Nullable(Date)) of 2 argument of function or: While processing CAST(1, 'Int8') OR CAST(0, 'Nullable(Date)'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT or(CAST(1 AS Int8),CAST( 0 AS Nullable(Date)));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&&, String&&) @ 0x000000000cd1537b in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionsLogical.cpp:539: DB::FunctionsLogicalDetail::FunctionAnyArityLogical::getReturnTypeImpl(std::vector, std::allocator>> const&) const @ 0x000000002f85f756 in /usr/bin/clickhouse 4. DB::IFunction::getReturnTypeImpl(std::vector> const&) const @ 0x000000000bd886cb in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:31:15.615192 [ 2559 ] {42eedcc4-4b07-437d-8ce0-eda5a203e17c} TCPHandler: Code: 43. DB::Exception: Illegal type (Nullable(Date)) of 2 argument of function or: While processing CAST(1, 'Int8') OR CAST(0, 'Nullable(Date)'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&&, String&&) @ 0x000000000cd1537b in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionsLogical.cpp:539: DB::FunctionsLogicalDetail::FunctionAnyArityLogical::getReturnTypeImpl(std::vector, std::allocator>> const&) const @ 0x000000002f85f756 in /usr/bin/clickhouse 4. DB::IFunction::getReturnTypeImpl(std::vector> const&) const @ 0x000000000bd886cb in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:31:15.722874 [ 2004 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:15.723282 [ 1986 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:15.723709 [ 2018 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:15.841706 [ 2559 ] {0350179b-c331-4fb1-9804-9d58603499b0} executeQuery: Code: 43. DB::Exception: Illegal type (Nullable(DateTime)) of 2 argument of function or: While processing CAST(1, 'Int8') OR CAST(0, 'Nullable(DateTime)'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT or(CAST(1 AS Int8),CAST( 0 AS Nullable(DateTime)));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&&, String&&) @ 0x000000000cd1537b in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionsLogical.cpp:539: DB::FunctionsLogicalDetail::FunctionAnyArityLogical::getReturnTypeImpl(std::vector, std::allocator>> const&) const @ 0x000000002f85f756 in /usr/bin/clickhouse 4. DB::IFunction::getReturnTypeImpl(std::vector> const&) const @ 0x000000000bd886cb in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:31:15.851232 [ 2559 ] {0350179b-c331-4fb1-9804-9d58603499b0} TCPHandler: Code: 43. DB::Exception: Illegal type (Nullable(DateTime)) of 2 argument of function or: While processing CAST(1, 'Int8') OR CAST(0, 'Nullable(DateTime)'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&&, String&&) @ 0x000000000cd1537b in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionsLogical.cpp:539: DB::FunctionsLogicalDetail::FunctionAnyArityLogical::getReturnTypeImpl(std::vector, std::allocator>> const&) const @ 0x000000002f85f756 in /usr/bin/clickhouse 4. DB::IFunction::getReturnTypeImpl(std::vector> const&) const @ 0x000000000bd886cb in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:31:16.027384 [ 2559 ] {1842d400-b792-41a4-bb50-0db5e26247d3} executeQuery: Code: 43. DB::Exception: Illegal type (Nullable(Enum8('0' = 0, 'z' = 1))) of 2 argument of function or: While processing CAST(1, 'Int8') OR CAST('0', 'Nullable(Enum8(\'0\' = 0, \'z\' = 1))'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT or(CAST(1 AS Int8),CAST( '0' AS Nullable(Enum8('0' = 0, 'z' = 1))));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&&, String&&) @ 0x000000000cd1537b in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionsLogical.cpp:539: DB::FunctionsLogicalDetail::FunctionAnyArityLogical::getReturnTypeImpl(std::vector, std::allocator>> const&) const @ 0x000000002f85f756 in /usr/bin/clickhouse 4. DB::IFunction::getReturnTypeImpl(std::vector> const&) const @ 0x000000000bd886cb in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:31:16.037293 [ 2559 ] {1842d400-b792-41a4-bb50-0db5e26247d3} TCPHandler: Code: 43. DB::Exception: Illegal type (Nullable(Enum8('0' = 0, 'z' = 1))) of 2 argument of function or: While processing CAST(1, 'Int8') OR CAST('0', 'Nullable(Enum8(\'0\' = 0, \'z\' = 1))'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&&, String&&) @ 0x000000000cd1537b in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionsLogical.cpp:539: DB::FunctionsLogicalDetail::FunctionAnyArityLogical::getReturnTypeImpl(std::vector, std::allocator>> const&) const @ 0x000000002f85f756 in /usr/bin/clickhouse 4. DB::IFunction::getReturnTypeImpl(std::vector> const&) const @ 0x000000000bd886cb in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:31:16.533549 [ 2559 ] {c71b3d40-f6b9-490c-ac45-453c93ee816d} executeQuery: Code: 43. DB::Exception: Illegal type (Nullable(Date)) of 2 argument of function or: While processing CAST(1, 'Int8') OR CAST(NULL, 'Nullable(Date)'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT or(CAST(1 AS Int8),CAST(NULL AS Nullable(Date)));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&&, String&&) @ 0x000000000cd1537b in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionsLogical.cpp:539: DB::FunctionsLogicalDetail::FunctionAnyArityLogical::getReturnTypeImpl(std::vector, std::allocator>> const&) const @ 0x000000002f85f756 in /usr/bin/clickhouse 4. DB::IFunction::getReturnTypeImpl(std::vector> const&) const @ 0x000000000bd886cb in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:31:16.553910 [ 2559 ] {c71b3d40-f6b9-490c-ac45-453c93ee816d} TCPHandler: Code: 43. DB::Exception: Illegal type (Nullable(Date)) of 2 argument of function or: While processing CAST(1, 'Int8') OR CAST(NULL, 'Nullable(Date)'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&&, String&&) @ 0x000000000cd1537b in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionsLogical.cpp:539: DB::FunctionsLogicalDetail::FunctionAnyArityLogical::getReturnTypeImpl(std::vector, std::allocator>> const&) const @ 0x000000002f85f756 in /usr/bin/clickhouse 4. DB::IFunction::getReturnTypeImpl(std::vector> const&) const @ 0x000000000bd886cb in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:31:16.725246 [ 2028 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:16.725670 [ 2034 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:16.731818 [ 1981 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:16.789313 [ 2559 ] {238c49ea-f3d8-428d-861d-803d7fc3dbc1} executeQuery: Code: 43. DB::Exception: Illegal type (Nullable(DateTime)) of 2 argument of function or: While processing CAST(1, 'Int8') OR CAST(NULL, 'Nullable(DateTime)'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT or(CAST(1 AS Int8),CAST(NULL AS Nullable(DateTime)));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&&, String&&) @ 0x000000000cd1537b in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionsLogical.cpp:539: DB::FunctionsLogicalDetail::FunctionAnyArityLogical::getReturnTypeImpl(std::vector, std::allocator>> const&) const @ 0x000000002f85f756 in /usr/bin/clickhouse 4. DB::IFunction::getReturnTypeImpl(std::vector> const&) const @ 0x000000000bd886cb in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:31:16.791761 [ 2559 ] {238c49ea-f3d8-428d-861d-803d7fc3dbc1} TCPHandler: Code: 43. DB::Exception: Illegal type (Nullable(DateTime)) of 2 argument of function or: While processing CAST(1, 'Int8') OR CAST(NULL, 'Nullable(DateTime)'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&&, String&&) @ 0x000000000cd1537b in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionsLogical.cpp:539: DB::FunctionsLogicalDetail::FunctionAnyArityLogical::getReturnTypeImpl(std::vector, std::allocator>> const&) const @ 0x000000002f85f756 in /usr/bin/clickhouse 4. DB::IFunction::getReturnTypeImpl(std::vector> const&) const @ 0x000000000bd886cb in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:31:16.917323 [ 2559 ] {4824cf2d-bb18-4002-8fe1-2b0381bbd0a7} executeQuery: Code: 43. DB::Exception: Illegal type (Nullable(DateTime)) of 2 argument of function or: While processing CAST(1, 'Int64') OR CAST(NULL, 'Nullable(DateTime)'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT or(CAST(1 AS Int64),CAST(NULL AS Nullable(DateTime)));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&&, String&&) @ 0x000000000cd1537b in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionsLogical.cpp:539: DB::FunctionsLogicalDetail::FunctionAnyArityLogical::getReturnTypeImpl(std::vector, std::allocator>> const&) const @ 0x000000002f85f756 in /usr/bin/clickhouse 4. DB::IFunction::getReturnTypeImpl(std::vector> const&) const @ 0x000000000bd886cb in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:31:16.923684 [ 2559 ] {4824cf2d-bb18-4002-8fe1-2b0381bbd0a7} TCPHandler: Code: 43. DB::Exception: Illegal type (Nullable(DateTime)) of 2 argument of function or: While processing CAST(1, 'Int64') OR CAST(NULL, 'Nullable(DateTime)'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&&, String&&) @ 0x000000000cd1537b in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionsLogical.cpp:539: DB::FunctionsLogicalDetail::FunctionAnyArityLogical::getReturnTypeImpl(std::vector, std::allocator>> const&) const @ 0x000000002f85f756 in /usr/bin/clickhouse 4. DB::IFunction::getReturnTypeImpl(std::vector> const&) const @ 0x000000000bd886cb in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 7. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:31:17.557249 [ 11374 ] {1ba7f20a-4f54-4753-8449-d468f83464fa} executeQuery: Code: 60. DB::Exception: Table `test_01191`.`table` doesn't exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35246) (comment: 01191_rename_dictionary.sql) (in query: RENAME DICTIONARY test_01191.table TO test_01191.table1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::getTableUnlocked(String const&) const @ 0x000000002f41f400 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseAtomic.cpp:0: DB::DatabaseAtomic::renameTable(std::shared_ptr, String const&, DB::IDatabase&, String const&, bool, bool) @ 0x000000002f31fe9a in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:141: DB::InterpreterRenameQuery::executeToTables(DB::ASTRenameQuery const&, std::vector> const&, std::map>, std::less, std::allocator>>>>&) @ 0x00000000314e5e9e in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:0: DB::InterpreterRenameQuery::execute() @ 0x00000000314e1497 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:17.563134 [ 11374 ] {1ba7f20a-4f54-4753-8449-d468f83464fa} TCPHandler: Code: 60. DB::Exception: Table `test_01191`.`table` doesn't exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::getTableUnlocked(String const&) const @ 0x000000002f41f400 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseAtomic.cpp:0: DB::DatabaseAtomic::renameTable(std::shared_ptr, String const&, DB::IDatabase&, String const&, bool, bool) @ 0x000000002f31fe9a in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:141: DB::InterpreterRenameQuery::executeToTables(DB::ASTRenameQuery const&, std::vector> const&, std::map>, std::less, std::allocator>>>>&) @ 0x00000000314e5e9e in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:0: DB::InterpreterRenameQuery::execute() @ 0x00000000314e1497 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:17.691451 [ 11374 ] {adc32edd-c883-4503-920c-6db8ee7cded8} executeQuery: Code: 80. DB::Exception: Use RENAME/EXCHANGE TABLE (instead of RENAME/EXCHANGE DICTIONARY) for tables. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35246) (comment: 01191_rename_dictionary.sql) (in query: EXCHANGE DICTIONARIES test_01191._ AND test_01191.dict;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [77]) @ 0x000000000d30d809 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseAtomic.cpp:245: DB::DatabaseAtomic::renameTable(std::shared_ptr, String const&, DB::IDatabase&, String const&, bool, bool) @ 0x000000002f3219ef in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:141: DB::InterpreterRenameQuery::executeToTables(DB::ASTRenameQuery const&, std::vector> const&, std::map>, std::less, std::allocator>>>>&) @ 0x00000000314e5e9e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:0: DB::InterpreterRenameQuery::execute() @ 0x00000000314e1497 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:17.729005 [ 2053 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:17.729457 [ 2088 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:17.733460 [ 2044 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:17.749709 [ 11374 ] {adc32edd-c883-4503-920c-6db8ee7cded8} TCPHandler: Code: 80. DB::Exception: Use RENAME/EXCHANGE TABLE (instead of RENAME/EXCHANGE DICTIONARY) for tables. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [77]) @ 0x000000000d30d809 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseAtomic.cpp:245: DB::DatabaseAtomic::renameTable(std::shared_ptr, String const&, DB::IDatabase&, String const&, bool, bool) @ 0x000000002f3219ef in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:141: DB::InterpreterRenameQuery::executeToTables(DB::ASTRenameQuery const&, std::vector> const&, std::map>, std::less, std::allocator>>>>&) @ 0x00000000314e5e9e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:0: DB::InterpreterRenameQuery::execute() @ 0x00000000314e1497 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:18.934680 [ 2055 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:18.934760 [ 2092 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:18.935065 [ 2559 ] {0e021e28-3c61-4512-80ef-86431c8898cc} executeQuery: Code: 44. DB::Exception: Second argument for function toFixedString must be unsigned integer: While processing toFixedString('', CAST(9223372036854775807, 'Int64')). (ILLEGAL_COLUMN) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT toFixedString('',CAST(9223372036854775807 as Int64));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::FunctionToFixedString::getReturnTypeImpl(std::vector> const&) const @ 0x000000001abe652c in /usr/bin/clickhouse 4. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:31:18.934900 [ 1985 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:18.959042 [ 2559 ] {0e021e28-3c61-4512-80ef-86431c8898cc} TCPHandler: Code: 44. DB::Exception: Second argument for function toFixedString must be unsigned integer: While processing toFixedString('', CAST(9223372036854775807, 'Int64')). (ILLEGAL_COLUMN), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::FunctionToFixedString::getReturnTypeImpl(std::vector> const&) const @ 0x000000001abe652c in /usr/bin/clickhouse 4. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:31:20.039729 [ 1982 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:20.039911 [ 2081 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:20.040468 [ 2104 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:20.051600 [ 11374 ] {edf52db4-a3a2-4b60-95f2-960f27ed6d78} executeQuery: Code: 80. DB::Exception: Use RENAME/EXCHANGE TABLE (instead of RENAME/EXCHANGE DICTIONARY) for tables. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35246) (comment: 01191_rename_dictionary.sql) (in query: RENAME DICTIONARY test_01191.t TO test_01191.dict1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [77]) @ 0x000000000d30d809 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseAtomic.cpp:245: DB::DatabaseAtomic::renameTable(std::shared_ptr, String const&, DB::IDatabase&, String const&, bool, bool) @ 0x000000002f3219ef in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:141: DB::InterpreterRenameQuery::executeToTables(DB::ASTRenameQuery const&, std::vector> const&, std::map>, std::less, std::allocator>>>>&) @ 0x00000000314e5e9e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:0: DB::InterpreterRenameQuery::execute() @ 0x00000000314e1497 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:20.053219 [ 11374 ] {edf52db4-a3a2-4b60-95f2-960f27ed6d78} TCPHandler: Code: 80. DB::Exception: Use RENAME/EXCHANGE TABLE (instead of RENAME/EXCHANGE DICTIONARY) for tables. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [77]) @ 0x000000000d30d809 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseAtomic.cpp:245: DB::DatabaseAtomic::renameTable(std::shared_ptr, String const&, DB::IDatabase&, String const&, bool, bool) @ 0x000000002f3219ef in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:141: DB::InterpreterRenameQuery::executeToTables(DB::ASTRenameQuery const&, std::vector> const&, std::map>, std::less, std::allocator>>>>&) @ 0x00000000314e5e9e in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterRenameQuery.cpp:0: DB::InterpreterRenameQuery::execute() @ 0x00000000314e1497 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:20.059941 [ 11405 ] {be09665b-1cad-4e12-9dbb-e98e5c629355} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Fault injection before operation. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35310) (comment: 02887_insert_quorum_wo_keeper_retries.sql) (in query: INSERT INTO quorum1 VALUES ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processInsertQuery() @ 0x0000000034eee177 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:503: DB::TCPHandler::runImpl() @ 0x0000000034ed6f7c in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:20.081923 [ 11405 ] {be09665b-1cad-4e12-9dbb-e98e5c629355} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Fault injection before operation. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processInsertQuery() @ 0x0000000034eee177 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:503: DB::TCPHandler::runImpl() @ 0x0000000034ed6f7c in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:20.271864 [ 11374 ] {070c246e-4a0f-4520-bcaa-c64d397964cb} executeQuery: Code: 80. DB::Exception: Table test_01191.t is not a Dictionary. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35246) (comment: 01191_rename_dictionary.sql) (in query: DROP DICTIONARY test_01191.t;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:135: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116e9c1 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:92: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000003116a56b in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168302 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:20.329358 [ 11374 ] {070c246e-4a0f-4520-bcaa-c64d397964cb} TCPHandler: Code: 80. DB::Exception: Table test_01191.t is not a Dictionary. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:135: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116e9c1 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:92: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000003116a56b in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168302 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:21.042416 [ 2048 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:21.042720 [ 2041 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:21.052756 [ 2051 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:22.045812 [ 2076 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:22.046485 [ 2083 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:22.055682 [ 2075 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:22.613091 [ 11445 ] {27418ba7-6fd9-4e43-ac2a-d4859d404a21} executeQuery: Code: 341. DB::Exception: Exception happened during execution of mutation 'mutation_4.txt' with part 'all_1_1_0' reason: 'Serialization error: part all_1_1_0 is locked by transaction 6443514376757976623'. This error maybe retryable or not. In case of unretryable error, mutation can be killed with KILL MUTATION query. (UNFINISHED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44046) (comment: 01415_sticking_mutations.sh) (in query: ALTER TABLE sticking_mutations DELETE WHERE value2 % 31 == 0 SETTINGS mutations_sync = 1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, String&&, String&, String&) @ 0x00000000343bf960 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeMutationStatus.cpp:26: DB::checkMutationStatus(std::optional&, std::set, std::allocator> const&) @ 0x00000000343bf397 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageMergeTree.cpp:0: DB::StorageMergeTree::waitForMutation(long, String const&, bool) @ 0x000000003490eaa1 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::StorageMergeTree::mutate(DB::MutationCommands const&, std::shared_ptr) @ 0x0000000034910f59 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112be20 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:22.621327 [ 11445 ] {27418ba7-6fd9-4e43-ac2a-d4859d404a21} TCPHandler: Code: 341. DB::Exception: Exception happened during execution of mutation 'mutation_4.txt' with part 'all_1_1_0' reason: 'Serialization error: part all_1_1_0 is locked by transaction 6443514376757976623'. This error maybe retryable or not. In case of unretryable error, mutation can be killed with KILL MUTATION query. (UNFINISHED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, String&&, String&, String&) @ 0x00000000343bf960 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeMutationStatus.cpp:26: DB::checkMutationStatus(std::optional&, std::set, std::allocator> const&) @ 0x00000000343bf397 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageMergeTree.cpp:0: DB::StorageMergeTree::waitForMutation(long, String const&, bool) @ 0x000000003490eaa1 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::StorageMergeTree::mutate(DB::MutationCommands const&, std::shared_ptr) @ 0x0000000034910f59 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112be20 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:23.047887 [ 2056 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:23.048784 [ 1996 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:23.058157 [ 2002 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:24.081944 [ 2034 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:24.082119 [ 2049 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:24.082091 [ 2028 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:24.082458 [ 2559 ] {ed0087b6-307e-43d3-a1c9-8e8470898cdd} executeQuery: Code: 43. DB::Exception: First argument for function arrayReduce must be constant string: name of aggregate function.: While processing arrayReduce(sumState(0), CAST(1, 'Int8')). (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT arrayReduce(sumState(0),CAST(1 AS Int8));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::FunctionArrayReduce::getReturnTypeImpl(std::vector> const&) const @ 0x000000001ca05f4e in /usr/bin/clickhouse 4. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:31:24.119283 [ 2559 ] {ed0087b6-307e-43d3-a1c9-8e8470898cdd} TCPHandler: Code: 43. DB::Exception: First argument for function arrayReduce must be constant string: name of aggregate function.: While processing arrayReduce(sumState(0), CAST(1, 'Int8')). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::FunctionArrayReduce::getReturnTypeImpl(std::vector> const&) const @ 0x000000001ca05f4e in /usr/bin/clickhouse 4. ./build_docker/./src/Functions/IFunction.cpp:489: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a4bb4 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:31:25.084240 [ 2078 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:25.084443 [ 2014 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:25.086074 [ 2093 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:25.561853 [ 2559 ] {1b9ebad4-7e9e-469c-ad51-b7ad204415fb} executeQuery: Code: 190. DB::Exception: Lengths of all arrays passed to aggregate function must be equal.: While executing AggregatingTransform. (SIZES_OF_ARRAYS_DONT_MATCH) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT uniqUpToArray([CAST( 0 AS Int8)],arrayPopBack([CAST( 0 AS Int8)]));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [66]) @ 0x0000000010024869 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:216: DB::checkAndGetNestedArrayOffset(DB::IColumn const**, unsigned long) @ 0x000000002d8c53fd in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::prepareAggregateInstructions(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, std::vector>, std::allocator>>>&, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&, std::vector>&, std::vector>, std::allocator>>>&) const @ 0x000000002fda9c83 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdab93b in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:25.568058 [ 2559 ] {1b9ebad4-7e9e-469c-ad51-b7ad204415fb} TCPHandler: Code: 190. DB::Exception: Lengths of all arrays passed to aggregate function must be equal.: While executing AggregatingTransform. (SIZES_OF_ARRAYS_DONT_MATCH), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [66]) @ 0x0000000010024869 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:216: DB::checkAndGetNestedArrayOffset(DB::IColumn const**, unsigned long) @ 0x000000002d8c53fd in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::prepareAggregateInstructions(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, std::vector>, std::allocator>>>&, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&, std::vector>&, std::vector>, std::allocator>>>&) const @ 0x000000002fda9c83 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdab93b in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:25.898295 [ 2559 ] {f2e4408b-3277-4001-809e-5eac98c7902f} executeQuery: Code: 190. DB::Exception: Lengths of all arrays passed to aggregate function must be equal.: While executing AggregatingTransform. (SIZES_OF_ARRAYS_DONT_MATCH) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT uniqCombinedArray([CAST( 0 AS Int8)],arrayPopBack([CAST( 0 AS Int8)]));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [66]) @ 0x0000000010024869 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:216: DB::checkAndGetNestedArrayOffset(DB::IColumn const**, unsigned long) @ 0x000000002d8c53fd in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::prepareAggregateInstructions(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, std::vector>, std::allocator>>>&, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&, std::vector>&, std::vector>, std::allocator>>>&) const @ 0x000000002fda9c83 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdab93b in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:25.903665 [ 2559 ] {f2e4408b-3277-4001-809e-5eac98c7902f} TCPHandler: Code: 190. DB::Exception: Lengths of all arrays passed to aggregate function must be equal.: While executing AggregatingTransform. (SIZES_OF_ARRAYS_DONT_MATCH), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [66]) @ 0x0000000010024869 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:216: DB::checkAndGetNestedArrayOffset(DB::IColumn const**, unsigned long) @ 0x000000002d8c53fd in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::prepareAggregateInstructions(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, std::vector>, std::allocator>>>&, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&, std::vector>&, std::vector>, std::allocator>>>&) const @ 0x000000002fda9c83 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdab93b in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:26.086980 [ 2099 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:26.087915 [ 2074 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:26.096597 [ 2096 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:26.159459 [ 2559 ] {80aaab9d-0917-4132-ba40-07c9df40f30b} executeQuery: Code: 46. DB::Exception: Unknown function uniqCombinedBiasCorrectedArray: While processing uniqCombinedBiasCorrectedArray([CAST(0, 'Int8')], arrayPopBack([CAST(0, 'Int8')])). (UNKNOWN_FUNCTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT uniqCombinedBiasCorrectedArray([CAST( 0 AS Int8)],arrayPopBack([CAST( 0 AS Int8)]));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&) @ 0x000000001d83e176 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionFactory.cpp:68: DB::FunctionFactory::getImpl(String const&, std::shared_ptr) const @ 0x000000002d8b27a2 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::FunctionFactory::get(String const&, std::shared_ptr) const @ 0x000000002d8b3bee in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd2268d in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 21. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 22. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 25. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:26.164858 [ 2559 ] {80aaab9d-0917-4132-ba40-07c9df40f30b} TCPHandler: Code: 46. DB::Exception: Unknown function uniqCombinedBiasCorrectedArray: While processing uniqCombinedBiasCorrectedArray([CAST(0, 'Int8')], arrayPopBack([CAST(0, 'Int8')])). (UNKNOWN_FUNCTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&) @ 0x000000001d83e176 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionFactory.cpp:68: DB::FunctionFactory::getImpl(String const&, std::shared_ptr) const @ 0x000000002d8b27a2 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::FunctionFactory::get(String const&, std::shared_ptr) const @ 0x000000002d8b3bee in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd2268d in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 21. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 22. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 25. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:26.223191 [ 2559 ] {a6ef285a-d870-4a9c-9e39-9b7fad6ff38c} executeQuery: Code: 46. DB::Exception: Unknown function uniqCombinedLinearCountingArray: While processing uniqCombinedLinearCountingArray([CAST(0, 'Int8')], arrayPopBack([CAST(0, 'Int8')])). (UNKNOWN_FUNCTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT uniqCombinedLinearCountingArray([CAST( 0 AS Int8)],arrayPopBack([CAST( 0 AS Int8)]));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&) @ 0x000000001d83e176 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionFactory.cpp:68: DB::FunctionFactory::getImpl(String const&, std::shared_ptr) const @ 0x000000002d8b27a2 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::FunctionFactory::get(String const&, std::shared_ptr) const @ 0x000000002d8b3bee in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd2268d in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 21. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 22. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 25. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:26.252119 [ 2559 ] {a6ef285a-d870-4a9c-9e39-9b7fad6ff38c} TCPHandler: Code: 46. DB::Exception: Unknown function uniqCombinedLinearCountingArray: While processing uniqCombinedLinearCountingArray([CAST(0, 'Int8')], arrayPopBack([CAST(0, 'Int8')])). (UNKNOWN_FUNCTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&) @ 0x000000001d83e176 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionFactory.cpp:68: DB::FunctionFactory::getImpl(String const&, std::shared_ptr) const @ 0x000000002d8b27a2 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::FunctionFactory::get(String const&, std::shared_ptr) const @ 0x000000002d8b3bee in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd2268d in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 21. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 22. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 25. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:26.407067 [ 2559 ] {d891485e-e35b-4609-b5db-1b7854e30a16} executeQuery: Code: 190. DB::Exception: Lengths of all arrays passed to aggregate function must be equal.: While executing AggregatingTransform. (SIZES_OF_ARRAYS_DONT_MATCH) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT uniqExactArray([CAST( 0 AS Int8)],arrayPopBack([CAST( 0 AS Int8)]));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [66]) @ 0x0000000010024869 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:216: DB::checkAndGetNestedArrayOffset(DB::IColumn const**, unsigned long) @ 0x000000002d8c53fd in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::prepareAggregateInstructions(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, std::vector>, std::allocator>>>&, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&, std::vector>&, std::vector>, std::allocator>>>&) const @ 0x000000002fda9c83 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdab93b in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:26.412413 [ 2559 ] {d891485e-e35b-4609-b5db-1b7854e30a16} TCPHandler: Code: 190. DB::Exception: Lengths of all arrays passed to aggregate function must be equal.: While executing AggregatingTransform. (SIZES_OF_ARRAYS_DONT_MATCH), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [66]) @ 0x0000000010024869 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:216: DB::checkAndGetNestedArrayOffset(DB::IColumn const**, unsigned long) @ 0x000000002d8c53fd in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::prepareAggregateInstructions(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, std::vector>, std::allocator>>>&, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&, std::vector>&, std::vector>, std::allocator>>>&) const @ 0x000000002fda9c83 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdab93b in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:26.561144 [ 2559 ] {2a5452d2-915c-4423-b0bc-06f73c5fe668} executeQuery: Code: 190. DB::Exception: Lengths of all arrays passed to aggregate function must be equal.: While executing AggregatingTransform. (SIZES_OF_ARRAYS_DONT_MATCH) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT COVAR_POPArray([CAST( 0 AS Int8)],arrayPopBack([CAST( 0 AS Int8)]));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [66]) @ 0x0000000010024869 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:216: DB::checkAndGetNestedArrayOffset(DB::IColumn const**, unsigned long) @ 0x000000002d8c53fd in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::prepareAggregateInstructions(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, std::vector>, std::allocator>>>&, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&, std::vector>&, std::vector>, std::allocator>>>&) const @ 0x000000002fda9c83 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdab93b in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:26.571186 [ 2559 ] {2a5452d2-915c-4423-b0bc-06f73c5fe668} TCPHandler: Code: 190. DB::Exception: Lengths of all arrays passed to aggregate function must be equal.: While executing AggregatingTransform. (SIZES_OF_ARRAYS_DONT_MATCH), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [66]) @ 0x0000000010024869 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:216: DB::checkAndGetNestedArrayOffset(DB::IColumn const**, unsigned long) @ 0x000000002d8c53fd in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::prepareAggregateInstructions(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, std::vector>, std::allocator>>>&, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&, std::vector>&, std::vector>, std::allocator>>>&) const @ 0x000000002fda9c83 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdab93b in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:26.748655 [ 2559 ] {5aa7bd26-3ec4-467b-ae9d-3004a3af4b3f} executeQuery: Code: 190. DB::Exception: Lengths of all arrays passed to aggregate function must be equal.: While executing AggregatingTransform. (SIZES_OF_ARRAYS_DONT_MATCH) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT COVAR_SAMPArray([CAST( 0 AS Int8)],arrayPopBack([CAST( 0 AS Int8)]));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [66]) @ 0x0000000010024869 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:216: DB::checkAndGetNestedArrayOffset(DB::IColumn const**, unsigned long) @ 0x000000002d8c53fd in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::prepareAggregateInstructions(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, std::vector>, std::allocator>>>&, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&, std::vector>&, std::vector>, std::allocator>>>&) const @ 0x000000002fda9c83 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdab93b in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:26.751350 [ 2559 ] {5aa7bd26-3ec4-467b-ae9d-3004a3af4b3f} TCPHandler: Code: 190. DB::Exception: Lengths of all arrays passed to aggregate function must be equal.: While executing AggregatingTransform. (SIZES_OF_ARRAYS_DONT_MATCH), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [66]) @ 0x0000000010024869 in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/FunctionHelpers.cpp:216: DB::checkAndGetNestedArrayOffset(DB::IColumn const**, unsigned long) @ 0x000000002d8c53fd in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::prepareAggregateInstructions(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, std::vector>, std::allocator>>>&, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&, std::vector>&, std::vector>, std::allocator>>>&) const @ 0x000000002fda9c83 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdab93b in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:27.007607 [ 2559 ] {773f4d5f-7f9b-46b2-823c-e3b0066dfc75} executeQuery: Code: 43. DB::Exception: Second argument (weight) for function quantileTimingWeighted must be unsigned integer, but it has type Int8. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT medianTimingWeightedArray([CAST( 0 AS Int8)],arrayPopBack([CAST( 0 AS Int8)]));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const* const&, String&&) @ 0x000000000eb54757 in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionQuantile.h:242: DB::AggregateFunctionQuantile, DB::NameQuantileTimingWeighted, true, float, false>::assertSecondArg(std::vector, std::allocator>> const&) @ 0x000000001fe6dd9f in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1467: std::shared_ptr DB::(anonymous namespace)::createAggregateFunctionQuantile(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::Settings const*) @ 0x000000001fe6c898 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d34d3 in /usr/bin/clickhouse 6. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 7. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d2e73 in /usr/bin/clickhouse 8. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr&, std::vector>&) @ 0x000000002fca6e39 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr&) @ 0x000000002fc9e410 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, unsigned long, bool, bool, std::shared_ptr, bool) @ 0x000000002fc9bbd4 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:313: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, std::vector> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr) @ 0x0000000031558e9e in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x00000000315190df in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 22. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 23. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 27. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 28. ? @ 0x00007f11b339dac3 in ? 29. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:27.020025 [ 2559 ] {773f4d5f-7f9b-46b2-823c-e3b0066dfc75} TCPHandler: Code: 43. DB::Exception: Second argument (weight) for function quantileTimingWeighted must be unsigned integer, but it has type Int8. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const* const&, String&&) @ 0x000000000eb54757 in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionQuantile.h:242: DB::AggregateFunctionQuantile, DB::NameQuantileTimingWeighted, true, float, false>::assertSecondArg(std::vector, std::allocator>> const&) @ 0x000000001fe6dd9f in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1467: std::shared_ptr DB::(anonymous namespace)::createAggregateFunctionQuantile(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::Settings const*) @ 0x000000001fe6c898 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d34d3 in /usr/bin/clickhouse 6. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 7. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d2e73 in /usr/bin/clickhouse 8. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr&, std::vector>&) @ 0x000000002fca6e39 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr&) @ 0x000000002fc9e410 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, unsigned long, bool, bool, std::shared_ptr, bool) @ 0x000000002fc9bbd4 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:313: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, std::vector> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr) @ 0x0000000031558e9e in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x00000000315190df in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 22. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 23. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 27. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 28. ? @ 0x00007f11b339dac3 in ? 29. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:27.088895 [ 2002 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:27.090034 [ 2007 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:27.098404 [ 2010 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:27.664047 [ 2559 ] {ca99dfe1-4c32-4599-86c7-0e924adbd67e} executeQuery: Code: 43. DB::Exception: Second argument (weight) for function quantilesDeterministic must be unsigned integer, but it has type Int32. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT quantilesDeterministicArray([CAST( 0 AS Int8)],arrayPopBack([CAST( 0 AS Int32)]));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const* const&, String&&) @ 0x000000000eb54757 in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionQuantile.h:242: DB::AggregateFunctionQuantile, DB::NameQuantilesDeterministic, true, double, true>::assertSecondArg(std::vector, std::allocator>> const&) @ 0x000000001f57397f in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1467: std::shared_ptr DB::(anonymous namespace)::createAggregateFunctionQuantile(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::Settings const*) @ 0x000000001f47e59f in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d34d3 in /usr/bin/clickhouse 6. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 7. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d2e73 in /usr/bin/clickhouse 8. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr&, std::vector>&) @ 0x000000002fca6e39 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr&) @ 0x000000002fc9e410 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, unsigned long, bool, bool, std::shared_ptr, bool) @ 0x000000002fc9bbd4 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:313: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, std::vector> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr) @ 0x0000000031558e9e in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x00000000315190df in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 22. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 23. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 27. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 28. ? @ 0x00007f11b339dac3 in ? 29. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:27.673020 [ 2559 ] {ca99dfe1-4c32-4599-86c7-0e924adbd67e} TCPHandler: Code: 43. DB::Exception: Second argument (weight) for function quantilesDeterministic must be unsigned integer, but it has type Int32. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const* const&, String&&) @ 0x000000000eb54757 in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionQuantile.h:242: DB::AggregateFunctionQuantile, DB::NameQuantilesDeterministic, true, double, true>::assertSecondArg(std::vector, std::allocator>> const&) @ 0x000000001f57397f in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1467: std::shared_ptr DB::(anonymous namespace)::createAggregateFunctionQuantile(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::Settings const*) @ 0x000000001f47e59f in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d34d3 in /usr/bin/clickhouse 6. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 7. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d2e73 in /usr/bin/clickhouse 8. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr&, std::vector>&) @ 0x000000002fca6e39 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr&) @ 0x000000002fc9e410 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, unsigned long, bool, bool, std::shared_ptr, bool) @ 0x000000002fc9bbd4 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:313: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, std::vector> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr) @ 0x0000000031558e9e in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x00000000315190df in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 22. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 23. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 27. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 28. ? @ 0x00007f11b339dac3 in ? 29. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:27.888622 [ 2559 ] {1ddb6138-2c1c-4dfc-9dc1-0f93ff5dacb9} executeQuery: Code: 43. DB::Exception: Illegal types Array(Nothing) and Array(Nothing) of argument for aggregate function maxIntersections. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT maxIntersections([], []);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String const&) @ 0x000000001e004b5b in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionMaxIntersections.cpp:27: DB::(anonymous namespace)::createAggregateFunctionMaxIntersections(DB::AggregateFunctionIntersectionsKind, String const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x00000000259363a8 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d34d3 in /usr/bin/clickhouse 5. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr&, std::vector>&) @ 0x000000002fca6e39 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr&) @ 0x000000002fc9e410 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, unsigned long, bool, bool, std::shared_ptr, bool) @ 0x000000002fc9bbd4 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:313: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, std::vector> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr) @ 0x0000000031558e9e in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x00000000315190df in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:27.907198 [ 2559 ] {1ddb6138-2c1c-4dfc-9dc1-0f93ff5dacb9} TCPHandler: Code: 43. DB::Exception: Illegal types Array(Nothing) and Array(Nothing) of argument for aggregate function maxIntersections. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String const&) @ 0x000000001e004b5b in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionMaxIntersections.cpp:27: DB::(anonymous namespace)::createAggregateFunctionMaxIntersections(DB::AggregateFunctionIntersectionsKind, String const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x00000000259363a8 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d34d3 in /usr/bin/clickhouse 5. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr&, std::vector>&) @ 0x000000002fca6e39 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr&) @ 0x000000002fc9e410 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, unsigned long, bool, bool, std::shared_ptr, bool) @ 0x000000002fc9bbd4 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:313: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, std::vector> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr) @ 0x0000000031558e9e in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x00000000315190df in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:28.090720 [ 1988 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:28.101526 [ 1999 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:28.102203 [ 2035 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:28.523613 [ 2559 ] {fca26970-2257-45cd-a8ac-4aae11cbe66f} executeQuery: Code: 43. DB::Exception: Illegal type Nothing of argument for aggregate function sum. (ILLEGAL_TYPE_OF_ARGUMENT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT sumMap([], []);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String const&) @ 0x000000000e2ae076 in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionSum.cpp:66: std::shared_ptr DB::(anonymous namespace)::createAggregateFunctionSum(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::Settings const*) @ 0x0000000023046ca4 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d34d3 in /usr/bin/clickhouse 5. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 6. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d2e73 in /usr/bin/clickhouse 7. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr&, std::vector>&) @ 0x000000002fca6e39 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr&) @ 0x000000002fc9e410 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, unsigned long, bool, bool, std::shared_ptr, bool) @ 0x000000002fc9bbd4 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:313: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, std::vector> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr) @ 0x0000000031558e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x00000000315190df in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 21. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 22. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 25. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:28.554458 [ 2559 ] {fca26970-2257-45cd-a8ac-4aae11cbe66f} TCPHandler: Code: 43. DB::Exception: Illegal type Nothing of argument for aggregate function sum. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String const&) @ 0x000000000e2ae076 in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionSum.cpp:66: std::shared_ptr DB::(anonymous namespace)::createAggregateFunctionSum(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::Settings const*) @ 0x0000000023046ca4 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d34d3 in /usr/bin/clickhouse 5. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 6. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d2e73 in /usr/bin/clickhouse 7. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr&, std::vector>&) @ 0x000000002fca6e39 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr&) @ 0x000000002fc9e410 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, unsigned long, bool, bool, std::shared_ptr, bool) @ 0x000000002fc9bbd4 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:313: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, std::vector> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr) @ 0x0000000031558e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x00000000315190df in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 21. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 22. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 25. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:29.003477 [ 2559 ] {893ff6d3-e6a0-428b-a152-129d525df05b} executeQuery: Code: 42. DB::Exception: -Array aggregate functions require at least one argument. (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47488) (comment: 00534_filimonov.sh) (in query: SELECT countArray();), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [57]) @ 0x0000000010d99ae9 in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionArray.cpp:29: DB::(anonymous namespace)::AggregateFunctionCombinatorArray::transformArguments(std::vector, std::allocator>> const&) const @ 0x00000000265793bd in /usr/bin/clickhouse 4. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d2ddd in /usr/bin/clickhouse 5. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr&, std::vector>&) @ 0x000000002fca6e39 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr&) @ 0x000000002fc9e410 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, unsigned long, bool, bool, std::shared_ptr, bool) @ 0x000000002fc9bbd4 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:313: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, std::vector> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr) @ 0x0000000031558e9e in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x00000000315190df in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:29.036867 [ 2559 ] {893ff6d3-e6a0-428b-a152-129d525df05b} TCPHandler: Code: 42. DB::Exception: -Array aggregate functions require at least one argument. (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [57]) @ 0x0000000010d99ae9 in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/AggregateFunctionArray.cpp:29: DB::(anonymous namespace)::AggregateFunctionCombinatorArray::transformArguments(std::vector, std::allocator>> const&) const @ 0x00000000265793bd in /usr/bin/clickhouse 4. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::getImpl(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x000000002d8d2ddd in /usr/bin/clickhouse 5. ./build_docker/./src/AggregateFunctions/AggregateFunctionFactory.cpp:0: DB::AggregateFunctionFactory::get(String const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x000000002d8cf8a2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::makeAggregateDescriptions(std::shared_ptr&, std::vector>&) @ 0x000000002fca6e39 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::analyzeAggregation(std::shared_ptr&) @ 0x000000002fc9e410 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalyzer::ExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, unsigned long, bool, bool, std::shared_ptr, bool) @ 0x000000002fc9bbd4 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ExpressionAnalyzer.h:313: DB::SelectQueryExpressionAnalyzer::SelectQueryExpressionAnalyzer(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, std::vector> const&, bool, DB::SelectQueryOptions const&, std::shared_ptr) @ 0x0000000031558e9e in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x00000000315190df in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:29.092621 [ 2066 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:29.105495 [ 2001 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:29.105790 [ 2025 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:30.199908 [ 2084 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:30.200079 [ 2099 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:30.200606 [ 2074 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:31.203077 [ 2017 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:31.204691 [ 2020 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:31.304245 [ 2016 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:32.206639 [ 2053 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:32.207778 [ 2043 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:32.306291 [ 2097 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:33.212257 [ 1987 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:33.212768 [ 2013 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:33.311334 [ 2093 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:34.215624 [ 2047 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:34.216247 [ 2028 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:34.315749 [ 2071 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:35.217099 [ 1989 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:35.218800 [ 2074 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:35.319416 [ 2084 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:36.218992 [ 2000 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:36.220719 [ 1980 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:36.327792 [ 2020 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:37.222692 [ 2050 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:37.223740 [ 2066 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:37.329895 [ 2068 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:38.225775 [ 2033 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:38.226245 [ 1975 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:38.231206 [ 11961 ] {41d18791-77fc-4120-a96e-b6508f91deeb} executeQuery: Code: 241. DB::Exception: Memory limit (for query) exceeded: would use 4.01 MiB (attempt to allocate chunk of 2098176 bytes), maximum: 3.81 MiB.: while executing 'FUNCTION repeat('aa' :: 1, number :: 0) -> repeat('aa', number) String : 2'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42596) (comment: 01656_test_query_log_factories_info.sql) (in query: SELECT repeat('aa', number) FROM numbers(10e3) SETTINGS max_memory_usage=4e6, max_block_size=100 FORMAT Null;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5d88 in /usr/bin/clickhouse 8. DB::(anonymous namespace)::FunctionRepeat::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7961f2 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 24. ? @ 0x00007f11b339dac3 in ? 25. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:38.271933 [ 11961 ] {41d18791-77fc-4120-a96e-b6508f91deeb} TCPHandler: Code: 241. DB::Exception: Memory limit (for query) exceeded: would use 4.01 MiB (attempt to allocate chunk of 2098176 bytes), maximum: 3.81 MiB.: while executing 'FUNCTION repeat('aa' :: 1, number :: 0) -> repeat('aa', number) String : 2'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5d88 in /usr/bin/clickhouse 8. DB::(anonymous namespace)::FunctionRepeat::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a7961f2 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 24. ? @ 0x00007f11b339dac3 in ? 25. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:38.338639 [ 2044 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:39.140150 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d::all_25_29_1}: Code: 234. DB::Exception: No active replica has part all_25_29_1 or covering part (cannot execute queue-0000000030: MERGE_PARTS with virtual parts [all_25_29_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:39.140188 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {c4447da2-5bf5-4f35-9905-8207a9f92cd7::all_25_29_1}: Code: 234. DB::Exception: No active replica has part all_25_29_1 or covering part (cannot execute queue-0000000030: MERGE_PARTS with virtual parts [all_25_29_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:39.140510 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {949d7fa7-a8c7-40ca-9a18-0f3bd830c00f::all_25_29_1}: Code: 234. DB::Exception: No active replica has part all_25_29_1 or covering part (cannot execute queue-0000000030: MERGE_PARTS with virtual parts [all_25_29_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:39.140741 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {62491bdd-3081-4b4a-83f6-3b90fdfbbd4b::all_25_29_1}: Code: 234. DB::Exception: No active replica has part all_25_29_1 or covering part (cannot execute queue-0000000030: MERGE_PARTS with virtual parts [all_25_29_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:39.140437 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {10cd912e-87f6-4680-9afb-58c2ab644105::all_25_29_1}: Code: 234. DB::Exception: No active replica has part all_25_29_1 or covering part (cannot execute queue-0000000030: MERGE_PARTS with virtual parts [all_25_29_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:39.229055 [ 2041 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:39.229453 [ 2048 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:39.340608 [ 2058 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:40.240220 [ 2074 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:40.241096 [ 2081 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:40.342965 [ 1978 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:40.508769 [ 1910 ] {b75c6d17-1a30-464c-b190-885aee9fd788} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43044) (comment: 02555_davengers_rename_chain.sh) (in query: INSERT INTO wrong_metadata_compact VALUES ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:40.528382 [ 1910 ] {b75c6d17-1a30-464c-b190-885aee9fd788} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:40.755191 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d::all_25_29_1}: Code: 234. DB::Exception: No active replica has part all_25_29_1 or covering part (cannot execute queue-0000000030: MERGE_PARTS with virtual parts [all_25_29_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:40.763820 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {10cd912e-87f6-4680-9afb-58c2ab644105::all_25_29_1}: Code: 234. DB::Exception: No active replica has part all_25_29_1 or covering part (cannot execute queue-0000000030: MERGE_PARTS with virtual parts [all_25_29_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:40.764313 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {c4447da2-5bf5-4f35-9905-8207a9f92cd7::all_25_29_1}: Code: 234. DB::Exception: No active replica has part all_25_29_1 or covering part (cannot execute queue-0000000030: MERGE_PARTS with virtual parts [all_25_29_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:40.765123 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {949d7fa7-a8c7-40ca-9a18-0f3bd830c00f::all_25_29_1}: Code: 234. DB::Exception: No active replica has part all_25_29_1 or covering part (cannot execute queue-0000000030: MERGE_PARTS with virtual parts [all_25_29_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:40.927891 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {62491bdd-3081-4b4a-83f6-3b90fdfbbd4b::all_25_29_1}: Code: 234. DB::Exception: No active replica has part all_25_29_1 or covering part (cannot execute queue-0000000030: MERGE_PARTS with virtual parts [all_25_29_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:40.985867 [ 12172 ] {85896726-ef94-49fe-85d1-805cd8fd646b} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43062) (comment: 02555_davengers_rename_chain.sh) (in query: SELECT * FROM wrong_metadata_compact ORDER by a1 FORMAT JSONEachRow), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:41.003858 [ 12172 ] {85896726-ef94-49fe-85d1-805cd8fd646b} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:41.215641 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {c4447da2-5bf5-4f35-9905-8207a9f92cd7::all_0_5_1}: Code: 234. DB::Exception: No active replica has part all_0_5_1 or covering part (cannot execute queue-0000000031: MERGE_PARTS with virtual parts [all_0_5_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:41.243549 [ 2055 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:41.243963 [ 2012 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:41.345433 [ 2034 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:42.098245 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d::all_25_29_1}: Code: 234. DB::Exception: No active replica has part all_25_29_1 or covering part (cannot execute queue-0000000030: MERGE_PARTS with virtual parts [all_25_29_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:42.104854 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {10cd912e-87f6-4680-9afb-58c2ab644105::all_25_29_1}: Code: 234. DB::Exception: No active replica has part all_25_29_1 or covering part (cannot execute queue-0000000030: MERGE_PARTS with virtual parts [all_25_29_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:42.142777 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {949d7fa7-a8c7-40ca-9a18-0f3bd830c00f::all_25_29_1}: Code: 234. DB::Exception: No active replica has part all_25_29_1 or covering part (cannot execute queue-0000000030: MERGE_PARTS with virtual parts [all_25_29_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:42.251625 [ 2080 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:42.252980 [ 2082 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:42.301216 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {c4447da2-5bf5-4f35-9905-8207a9f92cd7::all_25_29_1}: Code: 234. DB::Exception: No active replica has part all_25_29_1 or covering part (cannot execute queue-0000000030: MERGE_PARTS with virtual parts [all_25_29_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:42.356681 [ 2099 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:42.539234 [ 12172 ] {60769e4f-3eef-4c63-af42-92c5afa9fb3d} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43112) (comment: 02555_davengers_rename_chain.sh) (in query: SYSTEM SYNC REPLICA wrong_metadata_compact), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:0: DB::InterpreterSystemQuery::syncReplica(DB::ASTSystemQuery&) @ 0x0000000031726ce9 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:583: DB::InterpreterSystemQuery::execute() @ 0x0000000031707e66 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:42.543691 [ 12172 ] {60769e4f-3eef-4c63-af42-92c5afa9fb3d} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:0: DB::InterpreterSystemQuery::syncReplica(DB::ASTSystemQuery&) @ 0x0000000031726ce9 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:583: DB::InterpreterSystemQuery::execute() @ 0x0000000031707e66 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:42.558548 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {62491bdd-3081-4b4a-83f6-3b90fdfbbd4b::all_25_29_1}: Code: 234. DB::Exception: No active replica has part all_25_29_1 or covering part (cannot execute queue-0000000030: MERGE_PARTS with virtual parts [all_25_29_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:42.825051 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {c4447da2-5bf5-4f35-9905-8207a9f92cd7::all_0_5_1}: Code: 234. DB::Exception: No active replica has part all_0_5_1 or covering part (cannot execute queue-0000000031: MERGE_PARTS with virtual parts [all_0_5_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:43.099561 [ 12172 ] {b4bbb977-00a6-41e7-ad55-581dffd0cf1b} executeQuery: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43134) (comment: 02555_davengers_rename_chain.sh) (in query: SELECT * FROM wrong_metadata_compact order by a FORMAT JSONEachRow), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:43.118979 [ 12172 ] {b4bbb977-00a6-41e7-ad55-581dffd0cf1b} TCPHandler: Code: 60. DB::Exception: Table test_5.wrong_metadata_compact does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:43.306470 [ 2022 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:43.312653 [ 2021 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:43.427608 [ 2106 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:44.251614 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {949d7fa7-a8c7-40ca-9a18-0f3bd830c00f::all_25_29_1}: Code: 234. DB::Exception: No active replica has part all_25_29_1 or covering part (cannot execute queue-0000000030: MERGE_PARTS with virtual parts [all_25_29_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:44.427019 [ 2088 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:44.439655 [ 2076 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:44.485982 [ 2094 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:44.625720 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {c4447da2-5bf5-4f35-9905-8207a9f92cd7::all_0_5_1}: Code: 234. DB::Exception: No active replica has part all_0_5_1 or covering part (cannot execute queue-0000000031: MERGE_PARTS with virtual parts [all_0_5_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:44.924035 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {62491bdd-3081-4b4a-83f6-3b90fdfbbd4b::all_6_10_1}: Code: 234. DB::Exception: No active replica has part all_6_10_1 or covering part (cannot execute queue-0000000032: MERGE_PARTS with virtual parts [all_6_10_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:45.438467 [ 1993 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:45.447992 [ 2012 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:45.498646 [ 2009 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:45.544364 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {c4447da2-5bf5-4f35-9905-8207a9f92cd7::all_6_10_1}: Code: 234. DB::Exception: No active replica has part all_6_10_1 or covering part (cannot execute queue-0000000032: MERGE_PARTS with virtual parts [all_6_10_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:46.088058 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {62491bdd-3081-4b4a-83f6-3b90fdfbbd4b::all_6_10_1}: Code: 234. DB::Exception: No active replica has part all_6_10_1 or covering part (cannot execute queue-0000000032: MERGE_PARTS with virtual parts [all_6_10_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:46.464446 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {c4447da2-5bf5-4f35-9905-8207a9f92cd7::all_6_10_1}: Code: 234. DB::Exception: No active replica has part all_6_10_1 or covering part (cannot execute queue-0000000032: MERGE_PARTS with virtual parts [all_6_10_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:46.484090 [ 2097 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:46.486084 [ 1977 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:46.502765 [ 2035 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:47.486054 [ 2095 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:47.487962 [ 1982 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:47.504724 [ 1997 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:47.594571 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {62491bdd-3081-4b4a-83f6-3b90fdfbbd4b::all_6_10_1}: Code: 234. DB::Exception: No active replica has part all_6_10_1 or covering part (cannot execute queue-0000000032: MERGE_PARTS with virtual parts [all_6_10_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:48.157371 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {c4447da2-5bf5-4f35-9905-8207a9f92cd7::all_6_10_1}: Code: 234. DB::Exception: No active replica has part all_6_10_1 or covering part (cannot execute queue-0000000032: MERGE_PARTS with virtual parts [all_6_10_1]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:48.488104 [ 2008 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:48.490076 [ 2053 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:48.506872 [ 2062 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:49.490921 [ 1983 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:49.553972 [ 2007 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:49.556042 [ 1979 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:49.556046 [ 11864 ] {fd5070f2-a2ce-49e0-9fbd-200c77004224} executeQuery: Code: 407. DB::Exception: Numeric overflow: while executing 'FUNCTION plus(toDateTime(toStartOfFifteenMinutes(plus(toDateTime(1000.0001220703125), multiply(number, 65536)))) :: 3, multiply(number, 9223372036854775807) :: 2) -> plus(toDateTime(toStartOfFifteenMinutes(plus(toDateTime(1000.0001220703125), multiply(number, 65536)))), multiply(number, 9223372036854775807)) DateTime : 4'. (DECIMAL_OVERFLOW) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43298) (comment: 02772_jit_date_time_add.sql) (in query: SELECT DISTINCT result FROM (SELECT toStartOfFifteenMinutes(toDateTime(toStartOfFifteenMinutes(toDateTime(1000.0001220703125) + (number * 65536))) + (number * 9223372036854775807)) AS result FROM system.numbers LIMIT 1048576) ORDER BY result DESC NULLS FIRST FORMAT Null;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [17]) @ 0x000000000be2b889 in /usr/bin/clickhouse 3. void DB::Adder::vectorVector, 63ul, 64ul>, DB::PODArray, 63ul, 64ul>, DB::ColumnVector>(DB::PODArray, 63ul, 64ul> const&, DB::PODArray, 63ul, 64ul>&, DB::ColumnVector const&, DateLUTImpl const&, unsigned short, unsigned long) const @ 0x000000000e90d87d in /usr/bin/clickhouse 4. void DB::Adder::vectorVector, 63ul, 64ul>, DB::PODArray, 63ul, 64ul>>(DB::PODArray, 63ul, 64ul> const&, DB::PODArray, 63ul, 64ul>&, DB::IColumn const&, DateLUTImpl const&, unsigned short) const @ 0x000000000e90b6d9 in /usr/bin/clickhouse 5. DB::DateTimeAddIntervalImpl::execute(DB::AddSecondsImpl, std::vector> const&, std::shared_ptr const&, unsigned short) @ 0x000000000e901670 in /usr/bin/clickhouse 6. DB::FunctionDateOrDateTimeAddInterval::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000e8fdc24 in /usr/bin/clickhouse 7. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 10. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 11. DB::IFunctionBase::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000000bd84c5d in /usr/bin/clickhouse 12. DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000001935c473 in /usr/bin/clickhouse 13. DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x0000000019359b41 in /usr/bin/clickhouse 14. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 17. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:49.558820 [ 11864 ] {fd5070f2-a2ce-49e0-9fbd-200c77004224} TCPHandler: Code: 407. DB::Exception: Numeric overflow: while executing 'FUNCTION plus(toDateTime(toStartOfFifteenMinutes(plus(toDateTime(1000.0001220703125), multiply(number, 65536)))) :: 3, multiply(number, 9223372036854775807) :: 2) -> plus(toDateTime(toStartOfFifteenMinutes(plus(toDateTime(1000.0001220703125), multiply(number, 65536)))), multiply(number, 9223372036854775807)) DateTime : 4'. (DECIMAL_OVERFLOW), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [17]) @ 0x000000000be2b889 in /usr/bin/clickhouse 3. void DB::Adder::vectorVector, 63ul, 64ul>, DB::PODArray, 63ul, 64ul>, DB::ColumnVector>(DB::PODArray, 63ul, 64ul> const&, DB::PODArray, 63ul, 64ul>&, DB::ColumnVector const&, DateLUTImpl const&, unsigned short, unsigned long) const @ 0x000000000e90d87d in /usr/bin/clickhouse 4. void DB::Adder::vectorVector, 63ul, 64ul>, DB::PODArray, 63ul, 64ul>>(DB::PODArray, 63ul, 64ul> const&, DB::PODArray, 63ul, 64ul>&, DB::IColumn const&, DateLUTImpl const&, unsigned short) const @ 0x000000000e90b6d9 in /usr/bin/clickhouse 5. DB::DateTimeAddIntervalImpl::execute(DB::AddSecondsImpl, std::vector> const&, std::shared_ptr const&, unsigned short) @ 0x000000000e901670 in /usr/bin/clickhouse 6. DB::FunctionDateOrDateTimeAddInterval::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000e8fdc24 in /usr/bin/clickhouse 7. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 10. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 11. DB::IFunctionBase::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000000bd84c5d in /usr/bin/clickhouse 12. DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000001935c473 in /usr/bin/clickhouse 13. DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x0000000019359b41 in /usr/bin/clickhouse 14. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 17. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:49.603823 [ 2078 ] {} test_9.r1 (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.10.22 00:31:49.604542 [ 2095 ] {} test_9.r3 (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.10.22 00:31:49.607297 [ 1982 ] {} test_axafjroe.checksums_r2 (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.10.22 00:31:49.607810 [ 2031 ] {} test_axafjroe.checksums_r1 (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.10.22 00:31:49.609403 [ 2066 ] {} test_9.r6 (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.10.22 00:31:49.610138 [ 2091 ] {} test_9.r2 (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.10.22 00:31:49.610662 [ 2082 ] {} test_axafjroe.checksums_r3 (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.10.22 00:31:49.611950 [ 1994 ] {} test_9.r4 (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.10.22 00:31:49.615272 [ 2070 ] {} test_9.r5 (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.10.22 00:31:49.969114 [ 2213 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4165: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320375b in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 20. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:50.226860 [ 2196 ] {} 57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d::all_6_10_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r1/is_active. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4223: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(String const&, bool, String&) @ 0x00000000332336c7 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::MergeFromLogEntryTask::prepare() @ 0x0000000033e70a8b in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:175: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb55a in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:51.339526 [ 2210 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Coordination error: Connection loss. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x00000000185360c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::Exception(Coordination::Error) @ 0x0000000036353c20 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:633: zkutil::ZooKeeper::tryMulti(std::vector, std::allocator>> const&, std::vector, std::allocator>>&) @ 0x000000003637273b in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:821: zkutil::MultiReadResponses zkutil::ZooKeeper::multiRead>(std::__wrap_iter, std::__wrap_iter, std::function (String const&)>, std::function (String const&)>) @ 0x000000002f3d79fb in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::MultiReadResponses zkutil::ZooKeeper::exists>(std::__wrap_iter, std::__wrap_iter) @ 0x000000002f3d70a8 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.h:0: zkutil::ZooKeeper::checkExistsAndGetCreateAncestorsOps(String const&, std::vector, std::allocator>>&) @ 0x0000000036368d81 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeperWithFaultInjection.h:0: void DB::ZooKeeperWithFaultInjection::access, std::allocator>>&)::'lambda'(), void>(char const*, String const&, DB::ZooKeeperWithFaultInjection::checkExistsAndGetCreateAncestorsOps(String const&, std::vector, std::allocator>>&)::'lambda'(), DB::ZooKeeperWithFaultInjection::FaultCleanupTypeImpl::Type, std::function) @ 0x00000000334b3641 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeperWithFaultInjection.h:378: DB::ZooKeeperWithFaultInjection::checkExistsAndGetCreateAncestorsOps(String const&, std::vector, std::allocator>>&) @ 0x00000000334879fb in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::getZeroCopyLockNodeCreateOps(std::shared_ptr const&, String const&, std::vector, std::allocator>>&, int, bool, String const&, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000333f53b8 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:8832: DB::StorageReplicatedMergeTree::getLockSharedDataOps(DB::IMergeTreeDataPart const&, std::shared_ptr const&, bool, std::optional, std::vector, std::allocator>>&) const @ 0x00000000331abf0c in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1609: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x00000000331a5ca8 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214edf in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:51.397521 [ 2189 ] {} b6425a76-1577-4794-961d-2e29f5f2f5ac::all_6_10_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r3/parts. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:293: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x0000000036365801 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:266: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364b89 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:241: zkutil::ZooKeeper::getChildren(String const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364908 in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320444f in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:52.060036 [ 2208 ] {} test_9.r4 (949d7fa7-a8c7-40ca-9a18-0f3bd830c00f): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/quorum/parallel/all_24_24_0. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:542: zkutil::ZooKeeper::tryGetWatch(String const&, String&, Coordination::Stat*, std::function, Coordination::Error*) @ 0x000000003636fbfb in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:529: zkutil::ZooKeeper::tryGet(String const&, String&, Coordination::Stat*, std::shared_ptr const&, Coordination::Error*) @ 0x000000003636f108 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4267: DB::StorageReplicatedMergeTree::updateQuorum(String const&, bool) @ 0x00000000332c11d9 in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033216b44 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 17. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:52.369433 [ 2193 ] {} b6425a76-1577-4794-961d-2e29f5f2f5ac::all_11_19_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r1/parts. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:293: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x0000000036365801 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:266: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364b89 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:241: zkutil::ZooKeeper::getChildren(String const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364908 in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320444f in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:52.369749 [ 2216 ] {} test_9.r5 (10cd912e-87f6-4680-9afb-58c2ab644105): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Coordination error: Connection loss. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x00000000185360c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::Exception(Coordination::Error) @ 0x0000000036353c20 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:633: zkutil::ZooKeeper::tryMulti(std::vector, std::allocator>> const&, std::vector, std::allocator>>&) @ 0x000000003637273b in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::updateQuorum(String const&, bool) @ 0x00000000332c3f1a in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033216b44 in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:52.622661 [ 2190 ] {} 62491bdd-3081-4b4a-83f6-3b90fdfbbd4b::all_6_10_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/zero_copy/zero_copy_s3/c4447da2-5bf5-4f35-9905-8207a9f92cd7/all_6_10_1/test_rhu_unzmdajopzbvspptoepdzcggknsve/r3. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperWithFaultInjection.h:0: bool DB::ZooKeeperWithFaultInjection::access const&)::'lambda'(), bool>(char const*, String const&, DB::ZooKeeperWithFaultInjection::exists(String const&, Coordination::Stat*, std::shared_ptr const&)::'lambda'(), DB::ZooKeeperWithFaultInjection::FaultCleanupTypeImpl::Type, std::function) @ 0x000000002e4908a3 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeperWithFaultInjection.h:247: DB::ZooKeeperWithFaultInjection::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000002e490203 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:9695: DB::StorageReplicatedMergeTree::getZeroCopyLockNodeCreateOps(std::shared_ptr const&, String const&, std::vector, std::allocator>>&, int, bool, String const&, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000333f541b in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:8832: DB::StorageReplicatedMergeTree::getLockSharedDataOps(DB::IMergeTreeDataPart const&, std::shared_ptr const&, bool, std::optional, std::vector, std::allocator>>&) const @ 0x00000000331abf0c in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1609: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x00000000331a5ca8 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214edf in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 18. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:52.622676 [ 2184 ] {} 62491bdd-3081-4b4a-83f6-3b90fdfbbd4b::all_11_19_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r1/parts. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:293: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x0000000036365801 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:266: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364b89 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:241: zkutil::ZooKeeper::getChildren(String const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364908 in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320444f in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:52.926970 [ 2212 ] {} test_9.r3 (62491bdd-3081-4b4a-83f6-3b90fdfbbd4b): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:293: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x0000000036365801 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:266: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364b89 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:241: zkutil::ZooKeeper::getChildren(String const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364908 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000332024e0 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 17. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:53.669980 [ 2214 ] {} test_9.r4 (949d7fa7-a8c7-40ca-9a18-0f3bd830c00f): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r6/parts/all_22_22_0. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:542: zkutil::ZooKeeper::tryGetWatch(String const&, String&, Coordination::Stat*, std::function, Coordination::Error*) @ 0x000000003636fbfb in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:529: zkutil::ZooKeeper::tryGet(String const&, String&, Coordination::Stat*, std::shared_ptr const&, Coordination::Error*) @ 0x000000003636f108 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperWithFaultInjection.h:0: bool DB::ZooKeeperWithFaultInjection::access const&, Coordination::Error*)::'lambda'(), bool>(char const*, String const&, DB::ZooKeeperWithFaultInjection::tryGet(String const&, String&, Coordination::Stat*, std::shared_ptr const&, Coordination::Error*)::'lambda'(), DB::ZooKeeperWithFaultInjection::FaultCleanupTypeImpl::Type, std::function) @ 0x000000002e492bf2 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeperWithFaultInjection.h:173: DB::ZooKeeperWithFaultInjection::tryGet(String const&, String&, Coordination::Stat*, std::shared_ptr const&, Coordination::Error*) @ 0x00000000334723c9 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1513: DB::StorageReplicatedMergeTree::checkPartChecksumsAndAddCommitOps(std::shared_ptr const&, std::shared_ptr const&, std::vector, std::allocator>>&, String, std::unordered_set, std::equal_to, std::allocator>&) @ 0x0000000033199557 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1613: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x00000000331a60b8 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214edf in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 20. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:53.728748 [ 11396 ] {75ab41ec-26dd-466d-85ae-0a32151b7d21} executeQuery: Code: 236. DB::Exception: Shutdown is called for table. (ABORTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44294) (comment: 02882_replicated_fetch_checksums_doesnt_match.sql) (in query: SYSTEM SYNC REPLICA checksums_r2;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [29]) @ 0x000000000d3dbf69 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:8278: DB::StorageReplicatedMergeTree::waitForProcessingQueue(unsigned long, DB::SyncReplicaMode) @ 0x00000000333dcea8 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:0: DB::InterpreterSystemQuery::syncReplica(DB::ASTSystemQuery&) @ 0x00000000317275cd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:583: DB::InterpreterSystemQuery::execute() @ 0x0000000031707e66 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:53.784045 [ 2187 ] {} 10cd912e-87f6-4680-9afb-58c2ab644105::all_11_19_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r2/parts. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:293: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x0000000036365801 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:266: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364b89 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:241: zkutil::ZooKeeper::getChildren(String const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364908 in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320444f in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:53.784212 [ 11866 ] {8752abfa-ec0e-4350-bb83-b13d09681c78} executeQuery: Code: 999. Coordination::Exception: Coordination error: Connection loss. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:58124) (comment: 02013_json_function_null_column.sql) (in query: CREATE DATABASE IF NOT EXISTS test_95m22vgw ENGINE=Replicated('/test/db/test_8', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x00000000185360c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::Exception(Coordination::Error) @ 0x0000000036353c20 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:633: zkutil::ZooKeeper::tryMulti(std::vector, std::allocator>> const&, std::vector, std::allocator>>&) @ 0x000000003637273b in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createDatabaseNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f37f44f in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f378704 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:53.952323 [ 2195 ] {} 949d7fa7-a8c7-40ca-9a18-0f3bd830c00f::all_11_19_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r6/is_active. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4223: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(String const&, bool, String&) @ 0x00000000332336c7 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::MergeFromLogEntryTask::prepare() @ 0x0000000033e70a8b in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:175: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb55a in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:53.952476 [ 2037 ] {} test_9.r4 (949d7fa7-a8c7-40ca-9a18-0f3bd830c00f): void DB::StorageReplicatedMergeTree::mergeSelectingTask(): Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/log. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:542: zkutil::ZooKeeper::tryGetWatch(String const&, String&, Coordination::Stat*, std::function, Coordination::Error*) @ 0x000000003636fbfb in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:529: zkutil::ZooKeeper::tryGet(String const&, String&, Coordination::Stat*, std::shared_ptr const&, Coordination::Error*) @ 0x000000003636f108 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:506: zkutil::ZooKeeper::get(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636eb71 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ReplicatedMergeTreeQueue::pullLogsToQueue(std::shared_ptr, std::function, DB::ReplicatedMergeTreeQueue::PullLogsReason) @ 0x00000000347909d7 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:0: DB::ReplicatedMergeTreeMergePredicate::ReplicatedMergeTreeMergePredicate(DB::ReplicatedMergeTreeQueue&, std::shared_ptr&, std::optional, std::equal_to, std::allocator>>&&) @ 0x00000000347ecda3 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1849: DB::ReplicatedMergeTreeQueue::getMergePredicate(std::shared_ptr&, std::optional, std::equal_to, std::allocator>>&&) @ 0x00000000347d4fee in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::mergeSelectingTask() @ 0x0000000033282196 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 12. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:54.083802 [ 2002 ] {} test_9.r4 (949d7fa7-a8c7-40ca-9a18-0f3bd830c00f): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r4). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:54.786113 [ 2215 ] {} test_9.r4 (949d7fa7-a8c7-40ca-9a18-0f3bd830c00f): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:293: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x0000000036365801 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:266: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364b89 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:241: zkutil::ZooKeeper::getChildren(String const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364908 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeperWithFaultInjection.h:0: std::vector> DB::ZooKeeperWithFaultInjection::access const&, Coordination::ListRequestType)::'lambda'(), std::vector>>(char const*, String const&, DB::ZooKeeperWithFaultInjection::getChildren(String const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType)::'lambda'(), DB::ZooKeeperWithFaultInjection::FaultCleanupTypeImpl>>::Type, std::function) @ 0x000000002e48819a in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeperWithFaultInjection.h:143: DB::ZooKeeperWithFaultInjection::getChildren(String const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x000000002e487a8e in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::StorageReplicatedMergeTree::checkPartChecksumsAndAddCommitOps(std::shared_ptr const&, std::shared_ptr const&, std::vector, std::allocator>>&, String, std::unordered_set, std::equal_to, std::allocator>&) @ 0x0000000033197c1e in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1613: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x00000000331a60b8 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214edf in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 21. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 24. ? @ 0x00007f11b339dac3 in ? 25. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.271174 [ 2092 ] {} test_9.r4 (949d7fa7-a8c7-40ca-9a18-0f3bd830c00f): void DB::StorageReplicatedMergeTree::mutationsUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1329: Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function, std::shared_ptr>) @ 0x000000003645f90e in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363643ec in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:219: zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x000000003636360a in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:290: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363656e2 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:255: zkutil::ZooKeeper::getChildrenWatch(String const&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363653e6 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:900: DB::ReplicatedMergeTreeQueue::updateMutations(std::shared_ptr, std::shared_ptr>) @ 0x00000000347a14f9 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3252: DB::StorageReplicatedMergeTree::mutationsUpdatingTask() @ 0x000000003327b45c in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 13. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.290859 [ 2020 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.291394 [ 2018 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.291578 [ 1999 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.292857 [ 2026 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1329: Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function, std::shared_ptr>) @ 0x000000003645f90e in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363643ec in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:219: zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x000000003636360a in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:290: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363656e2 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:255: zkutil::ZooKeeper::getChildrenWatch(String const&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363653e6 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:900: DB::ReplicatedMergeTreeQueue::updateMutations(std::shared_ptr, std::shared_ptr>) @ 0x00000000347a14f9 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3252: DB::StorageReplicatedMergeTree::mutationsUpdatingTask() @ 0x000000003327b45c in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 13. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.293284 [ 1993 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1329: Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function, std::shared_ptr>) @ 0x000000003645f90e in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363643ec in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:219: zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x000000003636360a in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:290: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363656e2 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:255: zkutil::ZooKeeper::getChildrenWatch(String const&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363653e6 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:900: DB::ReplicatedMergeTreeQueue::updateMutations(std::shared_ptr, std::shared_ptr>) @ 0x00000000347a14f9 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3252: DB::StorageReplicatedMergeTree::mutationsUpdatingTask() @ 0x000000003327b45c in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 13. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.303223 [ 2012 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1329: Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function, std::shared_ptr>) @ 0x000000003645f90e in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363643ec in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:219: zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x000000003636360a in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:290: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363656e2 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:255: zkutil::ZooKeeper::getChildrenWatch(String const&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363653e6 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:900: DB::ReplicatedMergeTreeQueue::updateMutations(std::shared_ptr, std::shared_ptr>) @ 0x00000000347a14f9 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3252: DB::StorageReplicatedMergeTree::mutationsUpdatingTask() @ 0x000000003327b45c in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 13. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.362290 [ 2188 ] {} c4447da2-5bf5-4f35-9905-8207a9f92cd7::all_11_19_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Session expired (fault injected on send). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [41]) @ 0x0000000014c88449 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [41]) @ 0x000000003486fdda in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1526: Coordination::ZooKeeper::maybeInjectSendFault() @ 0x0000000036457308 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000364568a7 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4165: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320375b in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 18. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.363321 [ 2056 ] {} test_9.r4 (949d7fa7-a8c7-40ca-9a18-0f3bd830c00f): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r4). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.755894 [ 2209 ] {} test_9.r4 (949d7fa7-a8c7-40ca-9a18-0f3bd830c00f): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1741: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b2271 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 18. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.899664 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d::all_6_10_1}: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r1/is_active. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4223: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(String const&, bool, String&) @ 0x00000000332336c7 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::MergeFromLogEntryTask::prepare() @ 0x0000000033e70a8b in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:175: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb55a in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.899890 [ 11848 ] {f7784ad3-0564-4ea2-a2fa-9e25ca5f6b52} executeQuery: Code: 47. DB::Exception: Unknown qualified identifier: insert_select_src: While processing insert_select_src.* EXCEPT (middle_a, middle_b). (UNKNOWN_IDENTIFIER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43274) (comment: 01470_test_insert_select_asterisk.sql) (in query: INSERT INTO insert_select_dst(insert_select_src.* EXCEPT (middle_a, middle_b)) SELECT * FROM insert_select_src;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TranslateQualifiedNamesVisitor.cpp:170: DB::TranslateQualifiedNamesMatcher::visit(DB::ASTQualifiedAsterisk const&, std::shared_ptr const&, DB::TranslateQualifiedNamesMatcher::Data&) @ 0x0000000031fc9473 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/TranslateQualifiedNamesVisitor.cpp:0: DB::TranslateQualifiedNamesMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::TranslateQualifiedNamesMatcher::Data&) @ 0x0000000031fc59ff in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/TranslateQualifiedNamesVisitor.cpp:0: DB::TranslateQualifiedNamesMatcher::visit(std::shared_ptr&, DB::TranslateQualifiedNamesMatcher::Data&) @ 0x0000000031fc437b in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor>::doVisit(std::shared_ptr&) @ 0x0000000031f0019c in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::processColumnTransformers(String const&, std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000321635c2 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getSampleBlock(DB::ASTInsertQuery const&, std::shared_ptr const&, std::shared_ptr const&) const @ 0x00000000314a4281 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:397: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab9b7 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:55.899947 [ 1996 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.910222 [ 2086 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.910506 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {b6425a76-1577-4794-961d-2e29f5f2f5ac::all_6_10_1}: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r3/parts. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:293: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x0000000036365801 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:266: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364b89 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:241: zkutil::ZooKeeper::getChildren(String const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364908 in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320444f in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.910385 [ 1976 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.910879 [ 2213 ] {} test_9.r4 (949d7fa7-a8c7-40ca-9a18-0f3bd830c00f): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1741: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b2271 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 18. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:55.911735 [ 2210 ] {} test_9.r4 (949d7fa7-a8c7-40ca-9a18-0f3bd830c00f): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1741: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b2271 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 18. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.011604 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {b6425a76-1577-4794-961d-2e29f5f2f5ac::all_11_19_1}: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r1/parts. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:293: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x0000000036365801 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:266: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364b89 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:241: zkutil::ZooKeeper::getChildren(String const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364908 in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320444f in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.150506 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {62491bdd-3081-4b4a-83f6-3b90fdfbbd4b::all_11_19_1}: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r1/parts. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:293: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x0000000036365801 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:266: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364b89 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:241: zkutil::ZooKeeper::getChildren(String const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364908 in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320444f in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.150653 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {62491bdd-3081-4b4a-83f6-3b90fdfbbd4b::all_6_10_1}: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/zero_copy/zero_copy_s3/c4447da2-5bf5-4f35-9905-8207a9f92cd7/all_6_10_1/test_rhu_unzmdajopzbvspptoepdzcggknsve/r3. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperWithFaultInjection.h:0: bool DB::ZooKeeperWithFaultInjection::access const&)::'lambda'(), bool>(char const*, String const&, DB::ZooKeeperWithFaultInjection::exists(String const&, Coordination::Stat*, std::shared_ptr const&)::'lambda'(), DB::ZooKeeperWithFaultInjection::FaultCleanupTypeImpl::Type, std::function) @ 0x000000002e4908a3 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeperWithFaultInjection.h:247: DB::ZooKeeperWithFaultInjection::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000002e490203 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:9695: DB::StorageReplicatedMergeTree::getZeroCopyLockNodeCreateOps(std::shared_ptr const&, String const&, std::vector, std::allocator>>&, int, bool, String const&, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000333f541b in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:8832: DB::StorageReplicatedMergeTree::getLockSharedDataOps(DB::IMergeTreeDataPart const&, std::shared_ptr const&, bool, std::optional, std::vector, std::allocator>>&) const @ 0x00000000331abf0c in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1609: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x00000000331a5ca8 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214edf in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 18. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.151158 [ 2208 ] {} test_9.r4 (949d7fa7-a8c7-40ca-9a18-0f3bd830c00f): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1741: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b2271 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 18. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.151438 [ 3745 ] {fcaa78ec-9125-49d5-918d-cec8c1f5ac51} executeQuery: Code: 36. DB::Exception: Cannot replace partition '201403' because part '201403_1_7_1' has inconsistent granularity with table. (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59494) (comment: 00152_insert_different_granularity.sql) (in query: ALTER TABLE fixed_granularity_table REPLACE PARTITION 201403 FROM test.hits;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&, String const&) @ 0x000000001d887b76 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageMergeTree.cpp:2029: DB::StorageMergeTree::replacePartitionFrom(std::shared_ptr const&, std::shared_ptr const&, bool, std::shared_ptr) @ 0x00000000349510e1 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeData::alterPartition(std::shared_ptr const&, std::vector> const&, std::shared_ptr) @ 0x0000000033fd50ff in /usr/bin/clickhouse 5. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c16c in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.151041 [ 2212 ] {} test_9.r4 (949d7fa7-a8c7-40ca-9a18-0f3bd830c00f): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1741: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b2271 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 18. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.523407 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {10cd912e-87f6-4680-9afb-58c2ab644105::all_11_19_1}: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r2/parts. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:293: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x0000000036365801 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:266: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364b89 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:241: zkutil::ZooKeeper::getChildren(String const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364908 in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320444f in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.523541 [ 11866 ] {8752abfa-ec0e-4350-bb83-b13d09681c78} DynamicQueryHandler: Code: 999. Coordination::Exception: Coordination error: Connection loss. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x00000000185360c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::Exception(Coordination::Error) @ 0x0000000036353c20 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:633: zkutil::ZooKeeper::tryMulti(std::vector, std::allocator>> const&, std::vector, std::allocator>>&) @ 0x000000003637273b in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createDatabaseNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f37f44f in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f378704 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.523640 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {949d7fa7-a8c7-40ca-9a18-0f3bd830c00f::all_11_19_1}: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r6/is_active. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4223: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(String const&, bool, String&) @ 0x00000000332336c7 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::MergeFromLogEntryTask::prepare() @ 0x0000000033e70a8b in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:175: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb55a in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.523587 [ 11396 ] {75ab41ec-26dd-466d-85ae-0a32151b7d21} TCPHandler: Code: 236. DB::Exception: Shutdown is called for table. (ABORTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [29]) @ 0x000000000d3dbf69 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:8278: DB::StorageReplicatedMergeTree::waitForProcessingQueue(unsigned long, DB::SyncReplicaMode) @ 0x00000000333dcea8 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:0: DB::InterpreterSystemQuery::syncReplica(DB::ASTSystemQuery&) @ 0x00000000317275cd in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:583: DB::InterpreterSystemQuery::execute() @ 0x0000000031707e66 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.523403 [ 2214 ] {} test_9.r4 (949d7fa7-a8c7-40ca-9a18-0f3bd830c00f): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b564e in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 18. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.524002 [ 2216 ] {} test_9.r4 (949d7fa7-a8c7-40ca-9a18-0f3bd830c00f): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1741: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b2271 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 18. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.524962 [ 11869 ] {3e3c93d1-3568-48ef-b487-eebe4b83a73e} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42198) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r3 SELECT 24), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.524959 [ 3731 ] {06593fa0-0ee1-4737-8cf7-51bc99a3b560} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42246) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r4 SELECT 30), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.524831 [ 11863 ] {ee9eaaf4-4882-48de-8a54-eeb72748ca69} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42280) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r3 SELECT 23), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.524903 [ 11397 ] {40fbf9dc-6c13-417a-852d-e26d83819a33} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42318) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r4 SELECT 34), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.524498 [ 14377 ] {2bc84aac-52e3-4c07-b185-00c9d17dd17c} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44376) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r6 SELECT 51), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.525113 [ 11399 ] {d6a704ad-7445-4bef-86b3-bbe302bc057f} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42218) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r6 SELECT 53), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.525287 [ 12062 ] {e5a60750-1dce-483a-b954-5ba44f3faad0} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42334) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r3 SELECT 22), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.525366 [ 11349 ] {7263488e-b7d4-4149-87d4-19e87ecbc001} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42296) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r5 SELECT 43), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.525477 [ 11987 ] {3b567838-47e4-4fa8-9d91-1e0e7e0d1565} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42314) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r1 SELECT 2), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.525446 [ 11424 ] {57154bee-1d6d-4e1c-8de5-bac47bc39404} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44406) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r4 SELECT 33), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.525582 [ 11389 ] {579f9f25-8605-4db1-97fc-a549c5787c5a} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42222) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r6 SELECT 52), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.525993 [ 11877 ] {ec468795-9d9d-4ba0-9648-dee3c6acf6be} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42304) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r4 SELECT 32), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.526044 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {c4447da2-5bf5-4f35-9905-8207a9f92cd7::all_11_19_1}: Code: 999. Coordination::Exception: Session expired (fault injected on send). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [41]) @ 0x0000000014c88449 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [41]) @ 0x000000003486fdda in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1526: Coordination::ZooKeeper::maybeInjectSendFault() @ 0x0000000036457308 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000364568a7 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4165: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320375b in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 18. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.525978 [ 2479 ] {a7e2cd12-1778-4665-a4fb-a23adbfbfc2e} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42278) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r1 SELECT 1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.526126 [ 11383 ] {6c396f9f-bfcd-46ea-822a-8db369daf54d} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42260) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r6 SELECT 50), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.526056 [ 11404 ] {e6bc8888-be3d-4547-ad30-277a6007d4f7} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44392) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r4 SELECT 31), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.526766 [ 1977 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.526847 [ 11407 ] {00ee3ffb-93da-4be8-8c43-4ef71249f273} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44402) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r6 SELECT 54), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.526930 [ 2098 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.526615 [ 3745 ] {fcaa78ec-9125-49d5-918d-cec8c1f5ac51} TCPHandler: Code: 36. DB::Exception: Cannot replace partition '201403' because part '201403_1_7_1' has inconsistent granularity with table. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&, String const&) @ 0x000000001d887b76 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageMergeTree.cpp:2029: DB::StorageMergeTree::replacePartitionFrom(std::shared_ptr const&, std::shared_ptr const&, bool, std::shared_ptr) @ 0x00000000349510e1 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeData::alterPartition(std::shared_ptr const&, std::vector> const&, std::shared_ptr) @ 0x0000000033fd50ff in /usr/bin/clickhouse 5. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c16c in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.526729 [ 2102 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.526269 [ 11848 ] {f7784ad3-0564-4ea2-a2fa-9e25ca5f6b52} TCPHandler: Code: 47. DB::Exception: Unknown qualified identifier: insert_select_src: While processing insert_select_src.* EXCEPT (middle_a, middle_b). (UNKNOWN_IDENTIFIER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TranslateQualifiedNamesVisitor.cpp:170: DB::TranslateQualifiedNamesMatcher::visit(DB::ASTQualifiedAsterisk const&, std::shared_ptr const&, DB::TranslateQualifiedNamesMatcher::Data&) @ 0x0000000031fc9473 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/TranslateQualifiedNamesVisitor.cpp:0: DB::TranslateQualifiedNamesMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::TranslateQualifiedNamesMatcher::Data&) @ 0x0000000031fc59ff in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/TranslateQualifiedNamesVisitor.cpp:0: DB::TranslateQualifiedNamesMatcher::visit(std::shared_ptr&, DB::TranslateQualifiedNamesMatcher::Data&) @ 0x0000000031fc437b in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor>::doVisit(std::shared_ptr&) @ 0x0000000031f0019c in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::processColumnTransformers(String const&, std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000321635c2 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getSampleBlock(DB::ASTInsertQuery const&, std::shared_ptr const&, std::shared_ptr const&) const @ 0x00000000314a4281 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:397: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab9b7 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.526361 [ 2541 ] {ff9d8a0a-eb4a-4d09-ad2a-f6d53154185c} executeQuery: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42232) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r5 SELECT 42), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.541743 [ 3731 ] {06593fa0-0ee1-4737-8cf7-51bc99a3b560} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.542192 [ 14377 ] {2bc84aac-52e3-4c07-b185-00c9d17dd17c} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.542209 [ 11389 ] {579f9f25-8605-4db1-97fc-a549c5787c5a} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.542852 [ 11407 ] {00ee3ffb-93da-4be8-8c43-4ef71249f273} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.543623 [ 2541 ] {ff9d8a0a-eb4a-4d09-ad2a-f6d53154185c} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.543249 [ 11424 ] {57154bee-1d6d-4e1c-8de5-bac47bc39404} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.544182 [ 11869 ] {3e3c93d1-3568-48ef-b487-eebe4b83a73e} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.543836 [ 11383 ] {6c396f9f-bfcd-46ea-822a-8db369daf54d} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.544956 [ 12062 ] {e5a60750-1dce-483a-b954-5ba44f3faad0} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.547551 [ 11987 ] {3b567838-47e4-4fa8-9d91-1e0e7e0d1565} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.547766 [ 11397 ] {40fbf9dc-6c13-417a-852d-e26d83819a33} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.551445 [ 11404 ] {e6bc8888-be3d-4547-ad30-277a6007d4f7} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.551530 [ 11399 ] {d6a704ad-7445-4bef-86b3-bbe302bc057f} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.552168 [ 11863 ] {ee9eaaf4-4882-48de-8a54-eeb72748ca69} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.554639 [ 2479 ] {a7e2cd12-1778-4665-a4fb-a23adbfbfc2e} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.555936 [ 11349 ] {7263488e-b7d4-4149-87d4-19e87ecbc001} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.556861 [ 11877 ] {ec468795-9d9d-4ba0-9648-dee3c6acf6be} TCPHandler: Code: 319. DB::Exception: Unknown status, client must retry. Reason: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)). (UNKNOWN_STATUS_OF_INSERT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:1148: DB::ReplicatedMergeTreeSinkImpl::waitForQuorum(std::shared_ptr const&, String const&, String const&, int, unsigned long) const @ 0x00000000348635cd in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x000000003485d4f3 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:423: DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x000000003483c59b in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x00000000348593ca in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:56.902527 [ 2000 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.912663 [ 2090 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:56.916945 [ 2097 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:57.350973 [ 2216 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4165: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320375b in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 20. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:57.353583 [ 2069 ] {} test_9.r6 (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.10.22 00:31:57.356171 [ 2214 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:293: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x0000000036365801 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:266: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364b89 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:241: zkutil::ZooKeeper::getChildren(String const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364908 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000332024e0 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 17. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:57.407079 [ 2080 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/log. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:293: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x0000000036365801 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:248: zkutil::ZooKeeper::getChildrenWatch(String const&, Coordination::Stat*, std::function, Coordination::ListRequestType) @ 0x0000000036364ed0 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ReplicatedMergeTreeQueue::pullLogsToQueue(std::shared_ptr, std::function, DB::ReplicatedMergeTreeQueue::PullLogsReason) @ 0x00000000347911e6 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327a834 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 9. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 11. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:57.661569 [ 2215 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r3/is_active. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4165: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320375b in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:57.661638 [ 2212 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r1/is_active. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4165: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320375b in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:57.851413 [ 11854 ] {10d2276f-8528-49ae-977e-19798cfdee99} zkutil::EphemeralNodeHolder::~EphemeralNodeHolder(): Cannot remove /tables/test_axafjroe/checksums_table/replicas/r2/is_active: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /tables/test_axafjroe/checksums_table/replicas/r2/is_active. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:441: zkutil::ZooKeeper::tryRemove(String const&, int) @ 0x000000003636b376 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.h:673: zkutil::EphemeralNodeHolder::~EphemeralNodeHolder() @ 0x000000001dbc9fd8 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::StorageReplicatedMergeTree::partialShutdown() @ 0x00000000332d75b9 in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5011: DB::StorageReplicatedMergeTree::shutdown() @ 0x00000000332d5fce in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/IStorage.h:0: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116d70c in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:376: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr&, std::vector, DB::UUIDTag>, std::allocator, DB::UUIDTag>>>&) @ 0x00000000311734b2 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x000000003116ac2b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168341 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:57.983466 [ 1994 ] {} test_9.r4 (ReplicatedMergeTreeRestartingThread): Couldn't start replication (table will be in readonly mode): Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r4/queue. Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r4/queue. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:293: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x0000000036365801 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:266: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364b89 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:241: zkutil::ZooKeeper::getChildren(String const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364908 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ReplicatedMergeTreeQueue::load(std::shared_ptr) @ 0x0000000034777000 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:171: DB::ReplicatedMergeTreeRestartingThread::tryStartup() @ 0x0000000034829477 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:131: DB::ReplicatedMergeTreeRestartingThread::runImpl() @ 0x0000000034827134 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:58: DB::ReplicatedMergeTreeRestartingThread::run() @ 0x00000000348253f2 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 12. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:58.007950 [ 2105 ] {} test_9.r4 (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. 2024.10.22 00:31:58.033495 [ 11861 ] {652b23c6-6ef5-444a-8287-6518a94ad1d5} executeQuery: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /test/db/test_8/max_log_ptr. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:58624) (comment: 02098_date32_comparison.sql) (in query: CREATE DATABASE IF NOT EXISTS test_hnj0ge84 ENGINE=Replicated('/test/db/test_8', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:542: zkutil::ZooKeeper::tryGetWatch(String const&, String&, Coordination::Stat*, std::function, Coordination::Error*) @ 0x000000003636fbfb in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:529: zkutil::ZooKeeper::tryGet(String const&, String&, Coordination::Stat*, std::shared_ptr const&, Coordination::Error*) @ 0x000000003636f108 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:506: zkutil::ZooKeeper::get(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636eb71 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f381e59 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 10. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 16. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:58.188016 [ 2191 ] {} 57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d::all_6_10_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r3/is_active. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4223: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(String const&, bool, String&) @ 0x00000000332336c7 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::MergeFromLogEntryTask::prepare() @ 0x0000000033e70a8b in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:175: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb55a in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:58.188041 [ 2213 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r6/parts/all_25_29_1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1741: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b2271 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:58.188864 [ 2208 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r5/is_active. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4165: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320375b in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:58.322574 [ 2105 ] {} test_9.r4 (ReplicatedMergeTreeRestartingThread): We have part all_24_24_0 but we is not in quorum. Updating quorum. This shouldn't happen often. 2024.10.22 00:31:58.343615 [ 11356 ] {e03c68ba-e65d-4711-bd1a-c3abebf4af05} executeQuery: Code: 999. Coordination::Exception: Coordination error: Connection loss. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01272_totals_and_filter_bug.sql) (in query: /* ddl_entry=query-0000000018 */ CREATE TABLE test_5.foo UUID 'c4e3249f-d8c9-4097-83f3-88150d4bb8e2' (`server_date` Date, `dimension_1` String, `metric_1` UInt32) ENGINE = MergeTree PARTITION BY toYYYYMM(server_date) ORDER BY server_date SETTINGS index_granularity = 29515, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 0.9886935353279114, merge_max_block_size = 9992, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 3500187560, index_granularity_bytes = 29088590, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 34949, primary_key_compress_block_size = 99095), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x00000000185360c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::Exception(Coordination::Error) @ 0x0000000036353c20 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1293: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x00000000363726bb in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:627: zkutil::ZooKeeper::multi(std::vector, std::allocator>> const&) @ 0x000000003637261a in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/DDLTask.cpp:507: DB::ZooKeeperMetadataTransaction::commit() @ 0x000000002fac4fbf in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseAtomic.cpp:0: DB::DatabaseAtomic::commitCreateTable(DB::ASTCreateQuery const&, std::shared_ptr const&, String const&, String const&, std::shared_ptr) @ 0x000000002f323332 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1294: DB::DatabaseReplicated::commitCreateTable(DB::ASTCreateQuery const&, std::shared_ptr const&, String const&, String const&, std::shared_ptr) @ 0x000000002f3c71e6 in /usr/bin/clickhouse 9. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:241: DB::DatabaseOnDisk::createTable(std::shared_ptr, String const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000002f2eba0f in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66d72 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 17. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 18. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 23. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 24. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 25. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 27. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:58.466368 [ 2095 ] {} test_9.r3 (ReplicatedMergeTreeRestartingThread): Couldn't start replication (table will be in readonly mode): Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r6/is_active. Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r6/is_active. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeMergeStrategyPicker.cpp:127: DB::ReplicatedMergeTreeMergeStrategyPicker::refreshState() @ 0x0000000034740468 in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:0: DB::ReplicatedMergeTreeQueue::load(std::shared_ptr) @ 0x0000000034779b00 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:171: DB::ReplicatedMergeTreeRestartingThread::tryStartup() @ 0x0000000034829477 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:131: DB::ReplicatedMergeTreeRestartingThread::runImpl() @ 0x0000000034827134 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:58: DB::ReplicatedMergeTreeRestartingThread::run() @ 0x00000000348253f2 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 12. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:58.500158 [ 2078 ] {} test_9.r1 (ReplicatedMergeTreeRestartingThread): Couldn't start replication (table will be in readonly mode): Coordination error: Connection loss. Code: 999. Coordination::Exception: Coordination error: Connection loss. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x00000000185360c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::Exception(Coordination::Error) @ 0x0000000036353c20 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1293: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x00000000363726bb in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:627: zkutil::ZooKeeper::multi(std::vector, std::allocator>> const&) @ 0x000000003637261a in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:821: zkutil::MultiReadResponses zkutil::ZooKeeper::multiRead>(std::__wrap_iter, std::__wrap_iter, std::function (String const&)>, std::function (String const&)>) @ 0x000000001dd90a2c in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::MultiReadResponses zkutil::ZooKeeper::get>(std::__wrap_iter, std::__wrap_iter) @ 0x000000001dd900e8 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.h:0: DB::ReplicatedMergeTreeQueue::load(std::shared_ptr) @ 0x00000000347784eb in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:171: DB::ReplicatedMergeTreeRestartingThread::tryStartup() @ 0x0000000034829477 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:131: DB::ReplicatedMergeTreeRestartingThread::runImpl() @ 0x0000000034827134 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:58: DB::ReplicatedMergeTreeRestartingThread::run() @ 0x00000000348253f2 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 13. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:58.521779 [ 2092 ] {} test_9.r3 (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. 2024.10.22 00:31:58.522763 [ 2079 ] {} test_9.r1 (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. 2024.10.22 00:31:58.542077 [ 2085 ] {} test_9.r6 (ReplicatedMergeTreeCleanupThread): void DB::ReplicatedMergeTreeCleanupThread::run(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:199: DB::ReplicatedMergeTreeCleanupThread::clearOldLogs() @ 0x0000000034703f8c in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:0: DB::ReplicatedMergeTreeCleanupThread::iterate() @ 0x0000000034701b67 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:0: DB::ReplicatedMergeTreeCleanupThread::run() @ 0x00000000346ffb30 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 14. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:58.542173 [ 2209 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r5/is_active. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4165: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320375b in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:58.542651 [ 2070 ] {} test_9.r5 (ReplicatedMergeTreeRestartingThread): Couldn't start replication (table will be in readonly mode): Coordination error: Connection loss. Code: 999. Coordination::Exception: Coordination error: Connection loss. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x00000000185360c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::Exception(Coordination::Error) @ 0x0000000036353c20 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1293: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x00000000363726bb in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:627: zkutil::ZooKeeper::multi(std::vector, std::allocator>> const&) @ 0x000000003637261a in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:821: zkutil::MultiReadResponses zkutil::ZooKeeper::multiRead>(std::__wrap_iter, std::__wrap_iter, std::function (String const&)>, std::function (String const&)>) @ 0x000000001dd90a2c in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::MultiReadResponses zkutil::ZooKeeper::get>(std::__wrap_iter, std::__wrap_iter) @ 0x000000001dd900e8 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.h:0: DB::ReplicatedMergeTreeQueue::load(std::shared_ptr) @ 0x00000000347784eb in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:171: DB::ReplicatedMergeTreeRestartingThread::tryStartup() @ 0x0000000034829477 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:131: DB::ReplicatedMergeTreeRestartingThread::runImpl() @ 0x0000000034827134 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:58: DB::ReplicatedMergeTreeRestartingThread::run() @ 0x00000000348253f2 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 13. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:58.542906 [ 1979 ] {} test_axafjroe.checksums_r3 (efd531b8-e4b6-4026-97d8-1c1e23aa2c36): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /tables/test_axafjroe/checksums_table/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:58.543004 [ 2016 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): void DB::StorageReplicatedMergeTree::mutationsUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1329: Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function, std::shared_ptr>) @ 0x000000003645f90e in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363643ec in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:219: zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x000000003636360a in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:290: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363656e2 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:255: zkutil::ZooKeeper::getChildrenWatch(String const&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363653e6 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:900: DB::ReplicatedMergeTreeQueue::updateMutations(std::shared_ptr, std::shared_ptr>) @ 0x00000000347a14f9 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3252: DB::StorageReplicatedMergeTree::mutationsUpdatingTask() @ 0x000000003327b45c in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 13. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:58.553777 [ 1999 ] {} test_9.r5 (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. 2024.10.22 00:31:58.608553 [ 2080 ] {} test_axafjroe.checksums_r2 (6faa27f1-942e-49a0-8b0a-6223ea4502a5): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /tables/test_axafjroe/checksums_table/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:58.608529 [ 1997 ] {} test_axafjroe.checksums_r3 (efd531b8-e4b6-4026-97d8-1c1e23aa2c36): void DB::StorageReplicatedMergeTree::mutationsUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1329: Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function, std::shared_ptr>) @ 0x000000003645f90e in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363643ec in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:219: zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x000000003636360a in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:290: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363656e2 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:255: zkutil::ZooKeeper::getChildrenWatch(String const&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363653e6 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:900: DB::ReplicatedMergeTreeQueue::updateMutations(std::shared_ptr, std::shared_ptr>) @ 0x00000000347a14f9 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3252: DB::StorageReplicatedMergeTree::mutationsUpdatingTask() @ 0x000000003327b45c in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 13. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:58.611892 [ 12172 ] {1de10d55-e914-424a-9162-9c26a7418aaf} executeQuery: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /test/db/test_2/metadata. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:58574) (comment: 00023_totals_limit.sql) (in query: DROP DATABASE IF EXISTS test_91kxgswp ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:293: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x0000000036365801 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:266: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364b89 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:709: zkutil::ZooKeeper::tryRemoveChildrenRecursive(String const&, bool, zkutil::RemoveException) @ 0x000000003637cbe7 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:728: zkutil::ZooKeeper::tryRemoveChildrenRecursive(String const&, bool, zkutil::RemoveException) @ 0x000000003637dd5f in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:788: zkutil::ZooKeeper::tryRemoveRecursive(String const&) @ 0x00000000363812c0 in /usr/bin/clickhouse 9. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::drop(std::shared_ptr) @ 0x000000002f3c0e08 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::detachDatabase(std::shared_ptr, String const&, bool, bool) @ 0x000000002fb2f128 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:396: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr&, std::vector, DB::UUIDTag>, std::allocator, DB::UUIDTag>>>&) @ 0x0000000031173dab in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x000000003116ac2b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168341 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 17. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 18. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:58.847583 [ 2030 ] {} test_axafjroe.checksums_r2 (6faa27f1-942e-49a0-8b0a-6223ea4502a5): void DB::StorageReplicatedMergeTree::mutationsUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1329: Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function, std::shared_ptr>) @ 0x000000003645f90e in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363643ec in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:219: zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x000000003636360a in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:290: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363656e2 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:255: zkutil::ZooKeeper::getChildrenWatch(String const&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000363653e6 in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:900: DB::ReplicatedMergeTreeQueue::updateMutations(std::shared_ptr, std::shared_ptr>) @ 0x00000000347a14f9 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3252: DB::StorageReplicatedMergeTree::mutationsUpdatingTask() @ 0x000000003327b45c in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 13. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:58.971106 [ 2091 ] {} test_9.r2 (ReplicatedMergeTreeRestartingThread): Couldn't start replication (table will be in readonly mode): Coordination error: Session expired, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/quorum/parallel/all_22_22_0. Code: 999. Coordination::Exception: Coordination error: Session expired, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/quorum/parallel/all_22_22_0. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:542: zkutil::ZooKeeper::tryGetWatch(String const&, String&, Coordination::Stat*, std::function, Coordination::Error*) @ 0x000000003636fbfb in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:529: zkutil::ZooKeeper::tryGet(String const&, String&, Coordination::Stat*, std::shared_ptr const&, Coordination::Error*) @ 0x000000003636f108 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:270: DB::ReplicatedMergeTreeRestartingThread::updateQuorumIfWeHavePart() @ 0x00000000348333ee in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:192: DB::ReplicatedMergeTreeRestartingThread::tryStartup() @ 0x0000000034829611 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:131: DB::ReplicatedMergeTreeRestartingThread::runImpl() @ 0x0000000034827134 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp:58: DB::ReplicatedMergeTreeRestartingThread::run() @ 0x00000000348253f2 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 11. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:58.989721 [ 2058 ] {} test_9.r2 (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. 2024.10.22 00:31:59.457983 [ 2057 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:59.458071 [ 2210 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Session expired (fault injected on send). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [41]) @ 0x0000000014c88449 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [41]) @ 0x000000003486fdda in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1526: Coordination::ZooKeeper::maybeInjectSendFault() @ 0x0000000036457308 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000364568a7 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4165: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x000000003320375b in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1817: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e0616 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 21. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 24. ? @ 0x00007f11b339dac3 in ? 25. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:59.457852 [ 2003 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:59.458068 [ 2047 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:59.458335 [ 2214 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b564e in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 18. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:59.458586 [ 12261 ] {8114ebeb-265d-4cfb-817d-5b5b38011e98} executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59742) (comment: 02382_analyzer_matcher_join_using.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:59.458656 [ 2216 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1741: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b2271 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 18. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:59.459073 [ 2041 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:59.471368 [ 2106 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:59.477153 [ 2027 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:59.475678 [ 2212 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b564e in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 18. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:59.478064 [ 2215 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x000000001d5b5fa9 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:470: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x00000000363d371a in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000036456c79 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1257: Coordination::ZooKeeper::exists(String const&, std::function, std::shared_ptr>) @ 0x000000003645c083 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:0: zkutil::ZooKeeper::asyncTryExistsNoThrow(String const&, std::function) @ 0x000000003636c3f6 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::ZooKeeper::existsImpl(String const&, Coordination::Stat*, std::function) @ 0x000000003636b5cf in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636cf23 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b564e in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 18. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:59.672120 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d::all_6_10_1}: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r3/is_active. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4223: DB::StorageReplicatedMergeTree::findReplicaHavingCoveringPart(String const&, bool, String&) @ 0x00000000332336c7 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::MergeFromLogEntryTask::prepare() @ 0x0000000033e70a8b in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:175: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb55a in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:59.672202 [ 11861 ] {652b23c6-6ef5-444a-8287-6518a94ad1d5} DynamicQueryHandler: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /test/db/test_8/max_log_ptr. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:542: zkutil::ZooKeeper::tryGetWatch(String const&, String&, Coordination::Stat*, std::function, Coordination::Error*) @ 0x000000003636fbfb in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:529: zkutil::ZooKeeper::tryGet(String const&, String&, Coordination::Stat*, std::shared_ptr const&, Coordination::Error*) @ 0x000000003636f108 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:506: zkutil::ZooKeeper::get(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636eb71 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f381e59 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 10. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 16. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 17. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:59.675232 [ 2694 ] {dfce7ae0-937f-4739-aed4-2ce6f17a4068} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r4/is_active. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59630) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r4 SELECT 34), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:627: zkutil::ZooKeeper::multi(std::vector, std::allocator>> const&) @ 0x000000003637261a in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:821: zkutil::MultiReadResponses zkutil::ZooKeeper::multiRead>(std::__wrap_iter, std::__wrap_iter, std::function (String const&)>, std::function (String const&)>) @ 0x000000001dd90a2c in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::MultiReadResponses zkutil::ZooKeeper::get>(std::__wrap_iter, std::__wrap_iter) @ 0x000000001dd900e8 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.h:0: zkutil::MultiReadResponses DB::ZooKeeperWithFaultInjection::access> const&)::'lambda'(), zkutil::MultiReadResponses>(char const*, String const&, DB::ZooKeeperWithFaultInjection::get(std::vector> const&)::'lambda'(), DB::ZooKeeperWithFaultInjection::FaultCleanupTypeImpl>::Type, std::function) @ 0x0000000034871eb4 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeperWithFaultInjection.h:242: DB::ZooKeeperWithFaultInjection::get(std::vector> const&) @ 0x000000003486f90b in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:0: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()::operator()() const @ 0x000000003488c178 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:61: void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()&&) @ 0x0000000034889b78 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:46: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&) @ 0x000000003485aba0 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:0: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x000000003485554b in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:59.818158 [ 12261 ] {8114ebeb-265d-4cfb-817d-5b5b38011e98} TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:59.818195 [ 12172 ] {1de10d55-e914-424a-9162-9c26a7418aaf} DynamicQueryHandler: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /test/db/test_2/metadata. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:293: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x0000000036365801 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:266: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000036364b89 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:709: zkutil::ZooKeeper::tryRemoveChildrenRecursive(String const&, bool, zkutil::RemoveException) @ 0x000000003637cbe7 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:728: zkutil::ZooKeeper::tryRemoveChildrenRecursive(String const&, bool, zkutil::RemoveException) @ 0x000000003637dd5f in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:788: zkutil::ZooKeeper::tryRemoveRecursive(String const&) @ 0x00000000363812c0 in /usr/bin/clickhouse 9. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::drop(std::shared_ptr) @ 0x000000002f3c0e08 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::detachDatabase(std::shared_ptr, String const&, bool, bool) @ 0x000000002fb2f128 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:396: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr&, std::vector, DB::UUIDTag>, std::allocator, DB::UUIDTag>>>&) @ 0x0000000031173dab in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x000000003116ac2b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168341 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 17. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 18. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:31:59.818271 [ 2694 ] {dfce7ae0-937f-4739-aed4-2ce6f17a4068} TCPHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /clickhouse/tables/01509_check_many_parallel_quorum_inserts_long_test_9/parallel_quorum_many/replicas/r4/is_active. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:627: zkutil::ZooKeeper::multi(std::vector, std::allocator>> const&) @ 0x000000003637261a in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/vector:821: zkutil::MultiReadResponses zkutil::ZooKeeper::multiRead>(std::__wrap_iter, std::__wrap_iter, std::function (String const&)>, std::function (String const&)>) @ 0x000000001dd90a2c in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: zkutil::MultiReadResponses zkutil::ZooKeeper::get>(std::__wrap_iter, std::__wrap_iter) @ 0x000000001dd900e8 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.h:0: zkutil::MultiReadResponses DB::ZooKeeperWithFaultInjection::access> const&)::'lambda'(), zkutil::MultiReadResponses>(char const*, String const&, DB::ZooKeeperWithFaultInjection::get(std::vector> const&)::'lambda'(), DB::ZooKeeperWithFaultInjection::FaultCleanupTypeImpl>::Type, std::function) @ 0x0000000034871eb4 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ZooKeeper/ZooKeeperWithFaultInjection.h:242: DB::ZooKeeperWithFaultInjection::get(std::vector> const&) @ 0x000000003486f90b in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:0: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()::operator()() const @ 0x000000003488c178 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:61: void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()&&) @ 0x0000000034889b78 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:46: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&) @ 0x000000003485aba0 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:0: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x000000003485554b in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:59.861807 [ 11364 ] {776307e0-7e3e-405f-b3b0-1b3ee3fa5d66} executeQuery: Code: 285. DB::Exception: Number of alive replicas (1) is less than requested quorum (3/6). (TOO_FEW_LIVE_REPLICAS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59692) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r4 SELECT 30), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&, unsigned long&, unsigned long&) @ 0x000000002682b406 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:201: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()::operator()() const @ 0x000000003488dda3 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:61: void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()&&) @ 0x0000000034889b78 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:46: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&) @ 0x000000003485aba0 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:0: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x000000003485554b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:59.861997 [ 11408 ] {6f1d62cd-4f69-45d6-b3b9-87f535097d03} executeQuery: Code: 285. DB::Exception: Number of alive replicas (1) is less than requested quorum (3/6). (TOO_FEW_LIVE_REPLICAS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59740) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r4 SELECT 33), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&, unsigned long&, unsigned long&) @ 0x000000002682b406 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:201: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()::operator()() const @ 0x000000003488dda3 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:61: void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()&&) @ 0x0000000034889b78 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:46: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&) @ 0x000000003485aba0 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:0: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x000000003485554b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:59.862686 [ 12022 ] {4c6d8b65-0b20-4df8-ac82-f4a630bb86d9} executeQuery: Code: 285. DB::Exception: Number of alive replicas (1) is less than requested quorum (3/6). (TOO_FEW_LIVE_REPLICAS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59720) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r4 SELECT 31), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&, unsigned long&, unsigned long&) @ 0x000000002682b406 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:201: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()::operator()() const @ 0x000000003488dda3 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:61: void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()&&) @ 0x0000000034889b78 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:46: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&) @ 0x000000003485aba0 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:0: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x000000003485554b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:59.862609 [ 11356 ] {e03c68ba-e65d-4711-bd1a-c3abebf4af05} executeQuery: Code: 999. Coordination::Exception: Coordination error: Connection loss. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59478) (comment: 01272_totals_and_filter_bug.sql) (in query: CREATE TABLE foo (`server_date` Date, `dimension_1` String, `metric_1` UInt32) ENGINE = MergeTree PARTITION BY toYYYYMM(server_date) ORDER BY server_date SETTINGS index_granularity = 29515, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 0.9886935353279114, merge_max_block_size = 9992, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 3500187560, index_granularity_bytes = 29088590, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 34949, primary_key_compress_block_size = 99095), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x00000000185360c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::Exception(Coordination::Error) @ 0x0000000036353c20 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1293: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x00000000363726bb in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:627: zkutil::ZooKeeper::multi(std::vector, std::allocator>> const&) @ 0x000000003637261a in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/DDLTask.cpp:507: DB::ZooKeeperMetadataTransaction::commit() @ 0x000000002fac4fbf in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseAtomic.cpp:0: DB::DatabaseAtomic::commitCreateTable(DB::ASTCreateQuery const&, std::shared_ptr const&, String const&, String const&, std::shared_ptr) @ 0x000000002f323332 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1294: DB::DatabaseReplicated::commitCreateTable(DB::ASTCreateQuery const&, std::shared_ptr const&, String const&, String const&, std::shared_ptr) @ 0x000000002f3c71e6 in /usr/bin/clickhouse 9. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:241: DB::DatabaseOnDisk::createTable(std::shared_ptr, String const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000002f2eba0f in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66d72 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 17. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 18. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 23. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 24. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 25. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 27. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:59.862887 [ 11935 ] {9789ff5b-802d-4788-a707-2aae71747460} executeQuery: Code: 285. DB::Exception: Number of alive replicas (2) is less than requested quorum (3/6). (TOO_FEW_LIVE_REPLICAS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59672) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r3 SELECT 23), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&, unsigned long&, unsigned long&) @ 0x000000002682b406 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:201: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()::operator()() const @ 0x000000003488dda3 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:61: void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()&&) @ 0x0000000034889b78 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:46: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&) @ 0x000000003485aba0 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:0: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x000000003485554b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:59.864123 [ 11837 ] {1b02554f-2683-4388-80cf-772acafe0582} executeQuery: Code: 285. DB::Exception: Number of alive replicas (1) is less than requested quorum (3/6). (TOO_FEW_LIVE_REPLICAS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59620) (comment: 01509_check_many_parallel_quorum_inserts_long.sh) (in query: INSERT INTO r4 SELECT 32), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&, unsigned long&, unsigned long&) @ 0x000000002682b406 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:201: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()::operator()() const @ 0x000000003488dda3 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:61: void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()&&) @ 0x0000000034889b78 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:46: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&) @ 0x000000003485aba0 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:0: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x000000003485554b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:59.871357 [ 11364 ] {776307e0-7e3e-405f-b3b0-1b3ee3fa5d66} TCPHandler: Code: 285. DB::Exception: Number of alive replicas (1) is less than requested quorum (3/6). (TOO_FEW_LIVE_REPLICAS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&, unsigned long&, unsigned long&) @ 0x000000002682b406 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:201: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()::operator()() const @ 0x000000003488dda3 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:61: void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()&&) @ 0x0000000034889b78 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:46: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&) @ 0x000000003485aba0 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:0: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x000000003485554b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:59.875283 [ 11408 ] {6f1d62cd-4f69-45d6-b3b9-87f535097d03} TCPHandler: Code: 285. DB::Exception: Number of alive replicas (1) is less than requested quorum (3/6). (TOO_FEW_LIVE_REPLICAS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&, unsigned long&, unsigned long&) @ 0x000000002682b406 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:201: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()::operator()() const @ 0x000000003488dda3 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:61: void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()&&) @ 0x0000000034889b78 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:46: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&) @ 0x000000003485aba0 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:0: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x000000003485554b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:59.875747 [ 12022 ] {4c6d8b65-0b20-4df8-ac82-f4a630bb86d9} TCPHandler: Code: 285. DB::Exception: Number of alive replicas (1) is less than requested quorum (3/6). (TOO_FEW_LIVE_REPLICAS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&, unsigned long&, unsigned long&) @ 0x000000002682b406 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:201: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()::operator()() const @ 0x000000003488dda3 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:61: void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()&&) @ 0x0000000034889b78 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:46: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&) @ 0x000000003485aba0 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:0: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x000000003485554b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:59.880781 [ 11356 ] {e03c68ba-e65d-4711-bd1a-c3abebf4af05} TCPHandler: Code: 999. Coordination::Exception: Coordination error: Connection loss. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x00000000185360c7 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::Exception(Coordination::Error) @ 0x0000000036353c20 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1293: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x00000000363726bb in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:627: zkutil::ZooKeeper::multi(std::vector, std::allocator>> const&) @ 0x000000003637261a in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/DDLTask.cpp:507: DB::ZooKeeperMetadataTransaction::commit() @ 0x000000002fac4fbf in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseAtomic.cpp:0: DB::DatabaseAtomic::commitCreateTable(DB::ASTCreateQuery const&, std::shared_ptr const&, String const&, String const&, std::shared_ptr) @ 0x000000002f323332 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1294: DB::DatabaseReplicated::commitCreateTable(DB::ASTCreateQuery const&, std::shared_ptr const&, String const&, String const&, std::shared_ptr) @ 0x000000002f3c71e6 in /usr/bin/clickhouse 9. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:241: DB::DatabaseOnDisk::createTable(std::shared_ptr, String const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000002f2eba0f in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66d72 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 17. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 18. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 23. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 24. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 25. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 27. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:59.881406 [ 11837 ] {1b02554f-2683-4388-80cf-772acafe0582} TCPHandler: Code: 285. DB::Exception: Number of alive replicas (1) is less than requested quorum (3/6). (TOO_FEW_LIVE_REPLICAS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&, unsigned long&, unsigned long&) @ 0x000000002682b406 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:201: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()::operator()() const @ 0x000000003488dda3 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:61: void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()&&) @ 0x0000000034889b78 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:46: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&) @ 0x000000003485aba0 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:0: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x000000003485554b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:31:59.970218 [ 11935 ] {9789ff5b-802d-4788-a707-2aae71747460} TCPHandler: Code: 285. DB::Exception: Number of alive replicas (2) is less than requested quorum (3/6). (TOO_FEW_LIVE_REPLICAS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&, unsigned long&, unsigned long&) @ 0x000000002682b406 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:201: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()::operator()() const @ 0x000000003488dda3 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:61: void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&, void DB::ZooKeeperRetriesControl::retryLoop::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()>(DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&)::'lambda'()&&)::'lambda'()&&) @ 0x0000000034889b78 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ZooKeeperRetries.h:46: DB::ReplicatedMergeTreeSinkImpl::checkQuorumPrecondition(std::shared_ptr const&) @ 0x000000003485aba0 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:0: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x000000003485554b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:00.263613 [ 2772 ] {} DDLWorker(test_5): Replica seems to be lost: our_log_ptr=18, max_log_ptr=18, local_digest=9346647783738485003, zk_digest=13294366950578670813 2024.10.22 00:32:00.264069 [ 2772 ] {} DatabaseReplicated (test_5): Will recover replica with staled log pointer 18 from log pointer 18 2024.10.22 00:32:00.460599 [ 2068 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:00.460650 [ 2039 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:00.461240 [ 2000 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:00.473030 [ 2090 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:00.481121 [ 2094 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:00.478455 [ 2097 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:01.463817 [ 2054 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:01.464560 [ 1983 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:01.467929 [ 2013 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:01.475059 [ 2107 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:01.482906 [ 2010 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:01.489987 [ 2007 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:02.469966 [ 1996 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:02.470703 [ 2086 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:02.471850 [ 1976 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:02.477408 [ 2059 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:02.484972 [ 2029 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:02.703300 [ 2106 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:02.710983 [ 11408 ] {ff2671bd-5e7d-44c2-be4a-73387b1b4dad} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41688) (comment: 00167_parallel_parsing_with_names_and_types.sh) (in query: CREATE DATABASE IF NOT EXISTS test_5c3odpu8 ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:02.794992 [ 11408 ] {ff2671bd-5e7d-44c2-be4a-73387b1b4dad} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:03.493257 [ 11839 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:03.558445 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/udh/uqghwivrkhnpefdbkzmwozxejvado, total size 53111135, count 53111135, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 71f64ff7-2f1b-4f33-985c-6dd658cf2680, upload has finished false. 2024.10.22 00:32:03.559003 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/udh/uqghwivrkhnpefdbkzmwozxejvado, total size 53111135, count 53111135, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 71f64ff7-2f1b-4f33-985c-6dd658cf2680, upload has finished false 2024.10.22 00:32:03.563739 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/udh/uqghwivrkhnpefdbkzmwozxejvado, total size 53111135, count 53111135, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 71f64ff7-2f1b-4f33-985c-6dd658cf2680, upload has finished false 2024.10.22 00:32:04.015286 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/ntd/ynwcxqsyfgnojooaudjzdvvqknvcl, total size 51047329, count 51047329, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 15f261ba-f6c1-476d-84b2-b61d1897f60e, upload has finished false. 2024.10.22 00:32:04.016077 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/ntd/ynwcxqsyfgnojooaudjzdvvqknvcl, total size 51047329, count 51047329, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 15f261ba-f6c1-476d-84b2-b61d1897f60e, upload has finished false 2024.10.22 00:32:04.026425 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/ntd/ynwcxqsyfgnojooaudjzdvvqknvcl, total size 51047329, count 51047329, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 15f261ba-f6c1-476d-84b2-b61d1897f60e, upload has finished false 2024.10.22 00:32:04.036933 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/nee/dbgmkrixqlvuyngembzkvteuhcaww, total size 72922531, count 72922531, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 7a5b0533-cb2d-49f6-8653-f6211708efaf, upload has finished false. 2024.10.22 00:32:04.037559 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/nee/dbgmkrixqlvuyngembzkvteuhcaww, total size 72922531, count 72922531, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 7a5b0533-cb2d-49f6-8653-f6211708efaf, upload has finished false 2024.10.22 00:32:04.067339 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/nee/dbgmkrixqlvuyngembzkvteuhcaww, total size 72922531, count 72922531, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 7a5b0533-cb2d-49f6-8653-f6211708efaf, upload has finished false 2024.10.22 00:32:04.740480 [ 11388 ] {4519a15f-0fdf-4f50-8dc2-df031c384f9a} executeQuery: Code: 72. DB::ParsingException: Cannot parse number with multiple sign (+/-) characters: Cannot parse Int64 from String: While processing toInt64('--1'). (CANNOT_PARSE_NUMBER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44668) (comment: 01888_read_int_safe.sql) (in query: select toInt64('--1');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::ParsingException::ParsingException<>(int, FormatStringHelperImpl<>) @ 0x000000000be4f9b1 in /usr/bin/clickhouse 3. void DB::readIntTextImpl(long&, DB::ReadBuffer&) @ 0x000000000c1ace74 in /usr/bin/clickhouse 4. COW::immutable_ptr DB::ConvertThroughParsing, DB::NameToInt64, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c1ac05a in /usr/bin/clickhouse 5. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c18196d in /usr/bin/clickhouse 6. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17c9e6 in /usr/bin/clickhouse 7. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17a6aa in /usr/bin/clickhouse 8. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:32:04.928005 [ 2310 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 4194406 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long const*, unsigned long const*) @ 0x000000001d63315d in /usr/bin/clickhouse 8. ./build_docker/./src/Columns/ColumnString.cpp:32: DB::ColumnString::ColumnString(DB::ColumnString const&) @ 0x00000000326da21b in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper::clone() const @ 0x00000000326f2288 in /usr/bin/clickhouse 10. DB::IColumn::mutate(COW::immutable_ptr) @ 0x000000000cf55c03 in /usr/bin/clickhouse 11. ./build_docker/./src/Core/Block.cpp:470: DB::Block::mutateColumns() @ 0x000000002e6a0083 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x000000003415b994 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x00000000345c211c in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345abb85 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cbf959 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031cbd4c9 in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d9684f9 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:05.086319 [ 2074 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:05.086316 [ 2040 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:05.086865 [ 2066 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:05.086560 [ 2049 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:05.086781 [ 2099 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:05.086790 [ 1975 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:05.086495 [ 11406 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:05.130793 [ 2195 ] {} c4447da2-5bf5-4f35-9905-8207a9f92cd7::all_11_19_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:05.131678 [ 12113 ] {ce9b44bb-42cf-4de5-aac0-c6b0a7ebdd3e} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/egm/debmdbpopvgzerdzknacluzkwcyha, hash key: 9c0cea0706f1246c21e64134b28797ea, file_offset_of_buffer_end: 0, read_until_position: 50628, internal buffer end: 50628, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: ce9b44bb-42cf-4de5-aac0-c6b0a7ebdd3e:12570, file segment info: File segment: [0, 50627], key: 9c0cea0706f1246c21e64134b28797ea, state: DOWNLOADING, downloaded size: 0, reserved size: 50628, downloader id: ce9b44bb-42cf-4de5-aac0-c6b0a7ebdd3e:12570, current write offset: 0, caller id: ce9b44bb-42cf-4de5-aac0-c6b0a7ebdd3e:12570, kind: Regular, unbound: 0: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_19_19_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:35014) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format TSV ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/tuple:533: DB::AsynchronousBoundedReadBuffer::nextImpl() @ 0x000000002dd1f0ef in /usr/bin/clickhouse 20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 21. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec784a9 in /usr/bin/clickhouse 22. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray, 63ul, 64ul>&, DB::PODArray, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x000000002f282da8 in /usr/bin/clickhouse 23. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27dda3 in /usr/bin/clickhouse 24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 2024.10.22 00:32:05.579261 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1132965 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column URLRegions): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_10_10_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 1 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd8d085 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:222: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f161d92 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:611: DB::MergeTask::VerticalMergeStage::executeVerticalMergeForOneColumn() const @ 0x0000000033ea42f6 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:842: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba8f4 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::VerticalMergeStage::execute() @ 0x0000000033eabd39 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 29. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:05.579829 [ 2213 ] {} test_9.r3 (62491bdd-3081-4b4a-83f6-3b90fdfbbd4b): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:05.580068 [ 2186 ] {} b6425a76-1577-4794-961d-2e29f5f2f5ac::all_6_10_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:05.580058 [ 2208 ] {} test_9.r3 (62491bdd-3081-4b4a-83f6-3b90fdfbbd4b): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:05.579410 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 4440802 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:05.580770 [ 11388 ] {4519a15f-0fdf-4f50-8dc2-df031c384f9a} TCPHandler: Code: 72. DB::ParsingException: Cannot parse number with multiple sign (+/-) characters: Cannot parse Int64 from String: While processing toInt64('--1'). (CANNOT_PARSE_NUMBER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::ParsingException::ParsingException<>(int, FormatStringHelperImpl<>) @ 0x000000000be4f9b1 in /usr/bin/clickhouse 3. void DB::readIntTextImpl(long&, DB::ReadBuffer&) @ 0x000000000c1ace74 in /usr/bin/clickhouse 4. COW::immutable_ptr DB::ConvertThroughParsing, DB::NameToInt64, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c1ac05a in /usr/bin/clickhouse 5. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c18196d in /usr/bin/clickhouse 6. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17c9e6 in /usr/bin/clickhouse 7. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17a6aa in /usr/bin/clickhouse 8. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:32:05.674581 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/yrt/lyddpjjudnaxvxwcuoosjwkijnkvh, total size 46381564, count 46381564, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 785bac0f-69d4-4359-bd1d-d82007cb3057, upload has finished false. 2024.10.22 00:32:05.676210 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/yrt/lyddpjjudnaxvxwcuoosjwkijnkvh, total size 46381564, count 46381564, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 785bac0f-69d4-4359-bd1d-d82007cb3057, upload has finished false 2024.10.22 00:32:05.702935 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/yrt/lyddpjjudnaxvxwcuoosjwkijnkvh, total size 46381564, count 46381564, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 785bac0f-69d4-4359-bd1d-d82007cb3057, upload has finished false 2024.10.22 00:32:05.719211 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp779aff3a-3e77-4772-8f48-53141ba39e8b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:05.936219 [ 2191 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/vqf/cgaxmgpuqrixhupebqxwxzrjtyybg, total size 122841576, count 122841576, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 15c53829-c222-40be-9d7c-bd21996d79b5, upload has finished false. 2024.10.22 00:32:05.936675 [ 2191 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/vqf/cgaxmgpuqrixhupebqxwxzrjtyybg, total size 122841576, count 122841576, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 15c53829-c222-40be-9d7c-bd21996d79b5, upload has finished false 2024.10.22 00:32:05.941415 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/jfk/anavhzebkoqupqqxdihtyhruzvsjm, total size 52653122, count 52653122, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 868d6646-1480-45a9-8805-5dd683ed9394, upload has finished false. 2024.10.22 00:32:05.951724 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/jfk/anavhzebkoqupqqxdihtyhruzvsjm, total size 52653122, count 52653122, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 868d6646-1480-45a9-8805-5dd683ed9394, upload has finished false 2024.10.22 00:32:05.955502 [ 2191 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/vqf/cgaxmgpuqrixhupebqxwxzrjtyybg, total size 122841576, count 122841576, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 15c53829-c222-40be-9d7c-bd21996d79b5, upload has finished false 2024.10.22 00:32:05.964208 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/jfk/anavhzebkoqupqqxdihtyhruzvsjm, total size 52653122, count 52653122, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 868d6646-1480-45a9-8805-5dd683ed9394, upload has finished false 2024.10.22 00:32:05.989352 [ 2191 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/nna/vdbawyypxveeniaxynmgidjxdrbhg, total size 44069185, count 44069185, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id da9ec353-81b3-4da9-a7c6-062b6b26c8d5, upload has finished false. 2024.10.22 00:32:05.996120 [ 2191 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/nna/vdbawyypxveeniaxynmgidjxdrbhg, total size 44069185, count 44069185, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id da9ec353-81b3-4da9-a7c6-062b6b26c8d5, upload has finished false 2024.10.22 00:32:06.004432 [ 2191 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/nna/vdbawyypxveeniaxynmgidjxdrbhg, total size 44069185, count 44069185, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id da9ec353-81b3-4da9-a7c6-062b6b26c8d5, upload has finished false 2024.10.22 00:32:06.006233 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/dtz/lrkmfxvmwhsvwgqgmfkrkdwcebzro, total size 74896084, count 74896084, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 5b8956cc-43a9-4bf2-9b0f-8338e6332dc1, upload has finished false. 2024.10.22 00:32:06.006929 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/dtz/lrkmfxvmwhsvwgqgmfkrkdwcebzro, total size 74896084, count 74896084, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 5b8956cc-43a9-4bf2-9b0f-8338e6332dc1, upload has finished false 2024.10.22 00:32:06.016395 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/dtz/lrkmfxvmwhsvwgqgmfkrkdwcebzro, total size 74896084, count 74896084, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 5b8956cc-43a9-4bf2-9b0f-8338e6332dc1, upload has finished false 2024.10.22 00:32:06.078969 [ 2188 ] {} b6425a76-1577-4794-961d-2e29f5f2f5ac::all_11_19_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.079721 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {37576d78-d02f-4dc3-8453-2eec28cbe31a::202410_1_10_2}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1186263 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.080486 [ 11979 ] {cb515ed5-2473-4415-957a-af6681f5907b} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41696) (comment: 00009_uniq_distributed.sql) (in query: CREATE DATABASE IF NOT EXISTS test_bm8dkk8b ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:06.080666 [ 11849 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.080885 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 5170493 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c62f99 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c60a86 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d962b79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.082063 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {c4447da2-5bf5-4f35-9905-8207a9f92cd7::all_11_19_1}: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.082655 [ 2209 ] {} test_9.r6 (57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.083282 [ 2193 ] {} 57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d::all_11_19_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.082613 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {b6425a76-1577-4794-961d-2e29f5f2f5ac::all_6_10_1}: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.110761 [ 2191 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/faz/bogvyzjvvhztzugwgdafmlidcvtwo, total size 49592685, count 49592685, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 15d78c05-894b-437f-9b94-bdc2dacebf29, upload has finished false. 2024.10.22 00:32:06.119870 [ 2191 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/faz/bogvyzjvvhztzugwgdafmlidcvtwo, total size 49592685, count 49592685, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 15d78c05-894b-437f-9b94-bdc2dacebf29, upload has finished false 2024.10.22 00:32:06.140690 [ 2191 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/faz/bogvyzjvvhztzugwgdafmlidcvtwo, total size 49592685, count 49592685, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 15d78c05-894b-437f-9b94-bdc2dacebf29, upload has finished false 2024.10.22 00:32:06.481772 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {b6425a76-1577-4794-961d-2e29f5f2f5ac::all_11_19_1}: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.481980 [ 2215 ] {} test_9.r3 (62491bdd-3081-4b4a-83f6-3b90fdfbbd4b): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.481823 [ 11979 ] {cb515ed5-2473-4415-957a-af6681f5907b} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.482213 [ 2214 ] {} test_9.r3 (62491bdd-3081-4b4a-83f6-3b90fdfbbd4b): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.481995 [ 11391 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.482174 [ 2185 ] {} 57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d::all_6_10_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.482608 [ 2106 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.482646 [ 2065 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.482560 [ 2047 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.481797 [ 2241 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 4362941 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x00000000343d6317 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x00000000343d5adf in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x00000000345c6dbf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c4485 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ac548 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c726b9 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c701a6 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.482660 [ 2210 ] {} test_9.r3 (62491bdd-3081-4b4a-83f6-3b90fdfbbd4b): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.484360 [ 12113 ] {ce9b44bb-42cf-4de5-aac0-c6b0a7ebdd3e} DynamicQueryHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/egm/debmdbpopvgzerdzknacluzkwcyha, hash key: 9c0cea0706f1246c21e64134b28797ea, file_offset_of_buffer_end: 0, read_until_position: 50628, internal buffer end: 50628, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: ce9b44bb-42cf-4de5-aac0-c6b0a7ebdd3e:12570, file segment info: File segment: [0, 50627], key: 9c0cea0706f1246c21e64134b28797ea, state: DOWNLOADING, downloaded size: 0, reserved size: 50628, downloader id: ce9b44bb-42cf-4de5-aac0-c6b0a7ebdd3e:12570, current write offset: 0, caller id: ce9b44bb-42cf-4de5-aac0-c6b0a7ebdd3e:12570, kind: Regular, unbound: 0: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_19_19_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/tuple:533: DB::AsynchronousBoundedReadBuffer::nextImpl() @ 0x000000002dd1f0ef in /usr/bin/clickhouse 20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 21. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec784a9 in /usr/bin/clickhouse 22. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray, 63ul, 64ul>&, DB::PODArray, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x000000002f282da8 in /usr/bin/clickhouse 23. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27dda3 in /usr/bin/clickhouse 24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.483429 [ 2060 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.487234 [ 2098 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.484545 [ 1981 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.482712 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d::all_11_19_1}: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.643017 [ 2559 ] {c14ae281-2992-4e4a-8f85-e2f3d428244d} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01055_window_view_proc_hop_to.sh) (in query: /* ddl_entry=query-0000000019 */ CREATE TABLE test_5.dst UUID 'e65b1270-209c-4cc1-bf39-b8336728afac' (`count` UInt64) ENGINE = MergeTree ORDER BY tuple() SETTINGS index_granularity = 44238, min_bytes_for_wide_part = 0, ratio_of_defaults_for_sparse_serialization = 0.8560453653335571, merge_max_block_size = 11466, prefer_fetch_merged_part_size_threshold = 1, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 1, index_granularity_bytes = 4416630, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 42840, primary_key_compress_block_size = 15449), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 31. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 2024.10.22 00:32:06.699232 [ 11440 ] {9cea119f-de13-4b7d-8766-8311d7e207f9} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44676) (comment: 01162_strange_mutations.sh) (in query: insert into t values ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 2024.10.22 00:32:06.759282 [ 11445 ] {7e6f2fb4-01f0-4875-a673-ad408c9a3ff7} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1179648 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading from part /var/lib/clickhouse/disks/s3/store/0cd/0cd7b284-425d-40a2-bb08-a4b9b257aab0/all_1_1_0/ in table test_7.multidimensional (0cd7b284-425d-40a2-bb08-a4b9b257aab0) located on disk s3 of type s3, from mark 9 with max_rows_to_read = 8192): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44468) (comment: 00522_multidimensional.sql) (in query: SELECT sum(cityHash64(toString(value))) FROM multidimensional;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd8d085 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:141: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f161638 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/SerializationNamed.cpp:0: DB::SerializationNamed::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f1eb8b8 in /usr/bin/clickhouse 12. ./build_docker/./src/DataTypes/Serializations/SerializationTuple.cpp:0: DB::SerializationTuple::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f2975f2 in /usr/bin/clickhouse 13. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f162b09 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW::immutable_ptr&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional>) @ 0x0000000034413473 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderCompact.cpp:234: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x0000000034411539 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? 2024.10.22 00:32:06.899010 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:06.899292 [ 11388 ] {f606c568-1a4f-482e-a688-f8bf25f0963e} executeQuery: Code: 72. DB::ParsingException: Cannot parse number with multiple sign (+/-) characters: Cannot parse Int64 from String: While processing toInt64('+-1'). (CANNOT_PARSE_NUMBER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44668) (comment: 01888_read_int_safe.sql) (in query: select toInt64('+-1');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::ParsingException::ParsingException<>(int, FormatStringHelperImpl<>) @ 0x000000000be4f9b1 in /usr/bin/clickhouse 3. void DB::readIntTextImpl(long&, DB::ReadBuffer&) @ 0x000000000c1ace74 in /usr/bin/clickhouse 4. COW::immutable_ptr DB::ConvertThroughParsing, DB::NameToInt64, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c1ac05a in /usr/bin/clickhouse 5. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c18196d in /usr/bin/clickhouse 6. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17c9e6 in /usr/bin/clickhouse 7. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17a6aa in /usr/bin/clickhouse 8. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:32:06.900418 [ 11961 ] {17793563-0584-47a6-a6b2-1a694290156c} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1134265 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: test/ecx/wtgbctivvfjgkyaxvhxyxfofyfnsu, hash key: 992c9bac8b250e7bc3befdb9940f6f93, file_offset_of_buffer_end: 0, read_until_position: 71484, internal buffer end: 71484, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 17793563-0584-47a6-a6b2-1a694290156c:12409, file segment info: File segment: [0, 71483], key: 992c9bac8b250e7bc3befdb9940f6f93, state: DOWNLOADING, downloaded size: 0, reserved size: 71484, downloader id: 17793563-0584-47a6-a6b2-1a694290156c:12409, current write offset: 0, caller id: 17793563-0584-47a6-a6b2-1a694290156c:12409, kind: Regular, unbound: 0: (while reading from part /var/lib/clickhouse/disks/s3/store/6e4/6e4fe0b1-5b27-4b1d-845a-88e783da8be0/202410_50_50_0/ in table system.query_log (6e4fe0b1-5b27-4b1d-845a-88e783da8be0) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 262): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42596) (comment: 01656_test_query_log_factories_info.sql) (in query: SELECT used_database_engines FROM system.query_log WHERE current_database = currentDatabase() AND type == 'QueryFinish' AND (query LIKE '%database test_query_log_factories_info%') ORDER BY query_start_time DESC LIMIT 1 FORMAT TabSeparatedWithNames;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 19. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::CachedCompressedReadBuffer::nextImpl() @ 0x000000003442d1d0 in /usr/bin/clickhouse 21. DB::ReadBuffer::readBig(char*, unsigned long) @ 0x000000000cd59431 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f22575d in /usr/bin/clickhouse 23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW::immutable_ptr&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional>) @ 0x0000000034413473 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderCompact.cpp:234: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x0000000034411539 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 2024.10.22 00:32:07.039164 [ 3829 ] {eb3648e6-f2b2-4c8e-861e-54e509b12d95} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1388701 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:48056) (comment: 00170_s3_cache.sql) (in query: SELECT UserID, uniq(SearchPhrase) as m, count() as c FROM test.hits_s3 GROUP BY UserID, SearchPhrase ORDER BY UserID, m, c DESC LIMIT 10;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/memcpySmall.h:40: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x00000000326f2a83 in /usr/bin/clickhouse 11. ./build_docker/./src/Columns/IColumn.cpp:0: DB::IColumn::createWithOffsets(DB::PODArray, 63ul, 64ul> const&, DB::Field const&, unsigned long, unsigned long) const @ 0x0000000032bb7c3d in /usr/bin/clickhouse 12. ./build_docker/./src/Columns/ColumnSparse.cpp:132: DB::ColumnSparse::convertToFullColumnIfSparse() const @ 0x00000000326c5cd7 in /usr/bin/clickhouse 13. ./build_docker/./src/Columns/ColumnSparse.cpp:0: DB::recursiveRemoveSparse(COW::immutable_ptr const&) @ 0x00000000326d1d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdab0fc in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 21. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 24. ? @ 0x00007f11b339dac3 in ? 25. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.068088 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {10cd912e-87f6-4680-9afb-58c2ab644105::all_0_29_2}: Code: 234. DB::Exception: No active replica has part all_0_29_2 or covering part (cannot execute queue-0000000034: MERGE_PARTS with virtual parts [all_0_29_2]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.071354 [ 2843 ] {d4ec6780-c276-4457-a9dd-682d1baf37b9} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1062730 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:43848) (comment: 00170_s3_cache.sql) (in query: SELECT UserID, uniq(SearchPhrase) as m, count() as c FROM test.hits_s3 GROUP BY UserID, SearchPhrase ORDER BY UserID, m, c DESC LIMIT 10;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::ColumnString::insert(DB::Field const&) @ 0x00000000326f278b in /usr/bin/clickhouse 11. ./build_docker/./src/Columns/IColumn.h:186: DB::IColumn::insertMany(DB::Field const&, unsigned long) @ 0x000000002d8acf39 in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IColumn::createWithOffsets(DB::PODArray, 63ul, 64ul> const&, DB::Field const&, unsigned long, unsigned long) const @ 0x0000000032bb7bd4 in /usr/bin/clickhouse 13. ./build_docker/./src/Columns/ColumnSparse.cpp:132: DB::ColumnSparse::convertToFullColumnIfSparse() const @ 0x00000000326c5cd7 in /usr/bin/clickhouse 14. ./build_docker/./src/Columns/ColumnSparse.cpp:0: DB::recursiveRemoveSparse(COW::immutable_ptr const&) @ 0x00000000326d1d3d in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdab0fc in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.108694 [ 11325 ] {02366_5} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 33380216 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION range(modulo(number, 1000) :: 2) -> range(modulo(number, 1000)) Array(UInt16) : 1'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44588) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_5.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d62cacc in /usr/bin/clickhouse 10. COW::immutable_ptr DB::FunctionRange::executeInternal(DB::IColumn const*) const @ 0x000000001d4a83e5 in /usr/bin/clickhouse 11. DB::FunctionRange::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001d49a80d in /usr/bin/clickhouse 12. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.140083 [ 11846 ] {02366_3} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 33380216 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION range(modulo(number, 1000) :: 2) -> range(modulo(number, 1000)) Array(UInt16) : 1'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44622) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_3.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d62cacc in /usr/bin/clickhouse 10. COW::immutable_ptr DB::FunctionRange::executeInternal(DB::IColumn const*) const @ 0x000000001d4a83e5 in /usr/bin/clickhouse 11. DB::FunctionRange::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001d49a80d in /usr/bin/clickhouse 12. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.143218 [ 11330 ] {02366_4} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 33380216 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION range(modulo(number, 1000) :: 2) -> range(modulo(number, 1000)) Array(UInt16) : 1'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44620) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_4.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d62cacc in /usr/bin/clickhouse 10. COW::immutable_ptr DB::FunctionRange::executeInternal(DB::IColumn const*) const @ 0x000000001d4a83e5 in /usr/bin/clickhouse 11. DB::FunctionRange::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001d49a80d in /usr/bin/clickhouse 12. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.144247 [ 3096 ] {690ae707-4e30-40da-b4dc-f04098b7696d} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/ozn/vikuzbjrwxuzzbwbaopxrflhfgmwd, hash key: 2eb03e46d507c545b5a4022e781cb371, file_offset_of_buffer_end: 0, read_until_position: 13250, internal buffer end: 13250, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 690ae707-4e30-40da-b4dc-f04098b7696d:3151, file segment info: File segment: [0, 13249], key: 2eb03e46d507c545b5a4022e781cb371, state: DOWNLOADING, downloaded size: 0, reserved size: 13250, downloader id: 690ae707-4e30-40da-b4dc-f04098b7696d:3151, current write offset: 0, caller id: 690ae707-4e30-40da-b4dc-f04098b7696d:3151, kind: Regular, unbound: 0: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37715): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59746) (comment: 00033_aggregate_key_string.sql) (in query: SELECT SearchPhrase AS k1, count() AS c FROM test.hits GROUP BY k1 ORDER BY c DESC, k1 LIMIT 10 ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.299542 [ 11331 ] {02366_7} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 33380216 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION range(modulo(number, 1000) :: 2) -> range(modulo(number, 1000)) Array(UInt16) : 1'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44606) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_7.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d62cacc in /usr/bin/clickhouse 10. COW::immutable_ptr DB::FunctionRange::executeInternal(DB::IColumn const*) const @ 0x000000001d4a83e5 in /usr/bin/clickhouse 11. DB::FunctionRange::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001d49a80d in /usr/bin/clickhouse 12. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.303230 [ 11326 ] {02366_2} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 2097216 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44658) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_2.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory>::resize(unsigned long) @ 0x000000001d74f0a4 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:192: DB::BufferWithOutsideMemory::nextImpl() @ 0x00000000354600fe in /usr/bin/clickhouse 11. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000bdd68e8 in /usr/bin/clickhouse 12. void DB::detail::writeUIntTextFallback(unsigned short, DB::WriteBuffer&) @ 0x000000000c697b9b in /usr/bin/clickhouse 13. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:514: DB::SerializationArray::serializeTextJSON(DB::IColumn const&, unsigned long, DB::WriteBuffer&, DB::FormatSettings const&) const @ 0x000000002f166605 in /usr/bin/clickhouse 14. ./build_docker/./src/Formats/JSONUtils.cpp:431: DB::JSONUtils::writeFieldFromColumn(DB::IColumn const&, DB::ISerialization const&, unsigned long, bool, DB::FormatSettings const&, DB::WriteBuffer&, std::optional const&, unsigned long, char const*, bool) @ 0x000000003534ec82 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Formats/Impl/JSONEachRowRowOutputFormat.cpp:29: DB::JSONEachRowRowOutputFormat::writeField(DB::IColumn const&, DB::ISerialization const&, unsigned long) @ 0x000000003539f54d in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Formats/IRowOutputFormat.cpp:0: DB::IRowOutputFormat::write(std::vector::immutable_ptr, std::allocator::immutable_ptr>> const&, unsigned long) @ 0x0000000035040ca2 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Formats/IRowOutputFormat.cpp:32: DB::IRowOutputFormat::consume(DB::Chunk) @ 0x000000003504027b in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:613: DB::RowOutputFormatWithExceptionHandlerAdaptor, bool>::consume(DB::Chunk) @ 0x0000000035386814 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:613: DB::ParallelFormattingOutputFormat::formatterThreadFunction(unsigned long, unsigned long, std::shared_ptr const&) @ 0x000000003545b52b in /usr/bin/clickhouse 20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 21. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 24. ? @ 0x00007f11b339dac3 in ? 25. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.326804 [ 9738 ] {0829c6b1-b48a-48fc-b223-9f7cd9a2fc0c} ExecutingGraph: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 4194370 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory>::resize(unsigned long) @ 0x000000001d74f0a4 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:192: DB::BufferWithOutsideMemory::nextImpl() @ 0x00000000354600fe in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBuffer.h:0: DB::SerializationArray::serializeTextJSON(DB::IColumn const&, unsigned long, DB::WriteBuffer&, DB::FormatSettings const&) const @ 0x000000002f166532 in /usr/bin/clickhouse 12. ./build_docker/./src/Formats/JSONUtils.cpp:431: DB::JSONUtils::writeFieldFromColumn(DB::IColumn const&, DB::ISerialization const&, unsigned long, bool, DB::FormatSettings const&, DB::WriteBuffer&, std::optional const&, unsigned long, char const*, bool) @ 0x000000003534ec82 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Formats/Impl/JSONEachRowRowOutputFormat.cpp:29: DB::JSONEachRowRowOutputFormat::writeField(DB::IColumn const&, DB::ISerialization const&, unsigned long) @ 0x000000003539f54d in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Formats/IRowOutputFormat.cpp:0: DB::IRowOutputFormat::write(std::vector::immutable_ptr, std::allocator::immutable_ptr>> const&, unsigned long) @ 0x0000000035040ca2 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Formats/IRowOutputFormat.cpp:32: DB::IRowOutputFormat::consume(DB::Chunk) @ 0x000000003504027b in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:613: DB::RowOutputFormatWithExceptionHandlerAdaptor, bool>::consume(DB::Chunk) @ 0x0000000035386814 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:613: DB::ParallelFormattingOutputFormat::formatterThreadFunction(unsigned long, unsigned long, std::shared_ptr const&) @ 0x000000003545b52b in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 19. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.326994 [ 11358 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.327042 [ 2216 ] {} test_9.r3 (62491bdd-3081-4b4a-83f6-3b90fdfbbd4b): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.327059 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {57b1f8d2-c363-4ab4-a10d-a76aef8f0a8d::all_6_10_1}: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.328129 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1876094 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::SerializationArray::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f15c29f in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedColumnOnlyOutputStream.cpp:35: DB::MergedColumnOnlyOutputStream::MergedColumnOnlyOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::Block const&, std::shared_ptr, std::vector, std::allocator>> const&, std::set, std::allocator>*, DB::MergeTreeIndexGranularity const&, DB::MergeTreeIndexGranularityInfo const*) @ 0x00000000345d4876 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTask::VerticalMergeStage::prepareVerticalMergeForOneColumn() const @ 0x0000000033ea317a in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba8d8 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::VerticalMergeStage::execute() @ 0x0000000033eabd39 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.335822 [ 11851 ] {02366_1} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 2097216 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44600) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_1.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory>::resize(unsigned long) @ 0x000000001d74f0a4 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:192: DB::BufferWithOutsideMemory::nextImpl() @ 0x00000000354600fe in /usr/bin/clickhouse 11. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000bdd68e8 in /usr/bin/clickhouse 12. void DB::detail::writeUIntTextFallback(unsigned short, DB::WriteBuffer&) @ 0x000000000c697b9b in /usr/bin/clickhouse 13. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:514: DB::SerializationArray::serializeTextJSON(DB::IColumn const&, unsigned long, DB::WriteBuffer&, DB::FormatSettings const&) const @ 0x000000002f166605 in /usr/bin/clickhouse 14. ./build_docker/./src/Formats/JSONUtils.cpp:431: DB::JSONUtils::writeFieldFromColumn(DB::IColumn const&, DB::ISerialization const&, unsigned long, bool, DB::FormatSettings const&, DB::WriteBuffer&, std::optional const&, unsigned long, char const*, bool) @ 0x000000003534ec82 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Formats/Impl/JSONEachRowRowOutputFormat.cpp:29: DB::JSONEachRowRowOutputFormat::writeField(DB::IColumn const&, DB::ISerialization const&, unsigned long) @ 0x000000003539f54d in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Formats/IRowOutputFormat.cpp:0: DB::IRowOutputFormat::write(std::vector::immutable_ptr, std::allocator::immutable_ptr>> const&, unsigned long) @ 0x0000000035040ca2 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Formats/IRowOutputFormat.cpp:32: DB::IRowOutputFormat::consume(DB::Chunk) @ 0x000000003504027b in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:613: DB::RowOutputFormatWithExceptionHandlerAdaptor, bool>::consume(DB::Chunk) @ 0x0000000035386814 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:613: DB::ParallelFormattingOutputFormat::formatterThreadFunction(unsigned long, unsigned long, std::shared_ptr const&) @ 0x000000003545b52b in /usr/bin/clickhouse 20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 21. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 24. ? @ 0x00007f11b339dac3 in ? 25. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.335901 [ 3735 ] {02366_10} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 33380216 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION range(modulo(number, 1000) :: 2) -> range(modulo(number, 1000)) Array(UInt16) : 1'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44640) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_10.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d62cacc in /usr/bin/clickhouse 10. COW::immutable_ptr DB::FunctionRange::executeInternal(DB::IColumn const*) const @ 0x000000001d4a83e5 in /usr/bin/clickhouse 11. DB::FunctionRange::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001d49a80d in /usr/bin/clickhouse 12. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.335902 [ 11978 ] {02366_9} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 33380216 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION range(modulo(number, 1000) :: 2) -> range(modulo(number, 1000)) Array(UInt16) : 1'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44654) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_9.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d62cacc in /usr/bin/clickhouse 10. COW::immutable_ptr DB::FunctionRange::executeInternal(DB::IColumn const*) const @ 0x000000001d4a83e5 in /usr/bin/clickhouse 11. DB::FunctionRange::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001d49a80d in /usr/bin/clickhouse 12. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.339081 [ 11445 ] {7e6f2fb4-01f0-4875-a673-ad408c9a3ff7} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1179648 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading from part /var/lib/clickhouse/disks/s3/store/0cd/0cd7b284-425d-40a2-bb08-a4b9b257aab0/all_1_1_0/ in table test_7.multidimensional (0cd7b284-425d-40a2-bb08-a4b9b257aab0) located on disk s3 of type s3, from mark 9 with max_rows_to_read = 8192): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd8d085 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:141: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f161638 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/SerializationNamed.cpp:0: DB::SerializationNamed::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f1eb8b8 in /usr/bin/clickhouse 12. ./build_docker/./src/DataTypes/Serializations/SerializationTuple.cpp:0: DB::SerializationTuple::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f2975f2 in /usr/bin/clickhouse 13. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f162b09 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW::immutable_ptr&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional>) @ 0x0000000034413473 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderCompact.cpp:234: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x0000000034411539 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? 2024.10.22 00:32:07.339346 [ 11440 ] {9cea119f-de13-4b7d-8766-8311d7e207f9} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 2024.10.22 00:32:07.339602 [ 11388 ] {f606c568-1a4f-482e-a688-f8bf25f0963e} TCPHandler: Code: 72. DB::ParsingException: Cannot parse number with multiple sign (+/-) characters: Cannot parse Int64 from String: While processing toInt64('+-1'). (CANNOT_PARSE_NUMBER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::ParsingException::ParsingException<>(int, FormatStringHelperImpl<>) @ 0x000000000be4f9b1 in /usr/bin/clickhouse 3. void DB::readIntTextImpl(long&, DB::ReadBuffer&) @ 0x000000000c1ace74 in /usr/bin/clickhouse 4. COW::immutable_ptr DB::ConvertThroughParsing, DB::NameToInt64, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c1ac05a in /usr/bin/clickhouse 5. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c18196d in /usr/bin/clickhouse 6. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17c9e6 in /usr/bin/clickhouse 7. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17a6aa in /usr/bin/clickhouse 8. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:32:07.339651 [ 11961 ] {17793563-0584-47a6-a6b2-1a694290156c} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1134265 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: test/ecx/wtgbctivvfjgkyaxvhxyxfofyfnsu, hash key: 992c9bac8b250e7bc3befdb9940f6f93, file_offset_of_buffer_end: 0, read_until_position: 71484, internal buffer end: 71484, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 17793563-0584-47a6-a6b2-1a694290156c:12409, file segment info: File segment: [0, 71483], key: 992c9bac8b250e7bc3befdb9940f6f93, state: DOWNLOADING, downloaded size: 0, reserved size: 71484, downloader id: 17793563-0584-47a6-a6b2-1a694290156c:12409, current write offset: 0, caller id: 17793563-0584-47a6-a6b2-1a694290156c:12409, kind: Regular, unbound: 0: (while reading from part /var/lib/clickhouse/disks/s3/store/6e4/6e4fe0b1-5b27-4b1d-845a-88e783da8be0/202410_50_50_0/ in table system.query_log (6e4fe0b1-5b27-4b1d-845a-88e783da8be0) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 262): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 19. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::CachedCompressedReadBuffer::nextImpl() @ 0x000000003442d1d0 in /usr/bin/clickhouse 21. DB::ReadBuffer::readBig(char*, unsigned long) @ 0x000000000cd59431 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f22575d in /usr/bin/clickhouse 23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW::immutable_ptr&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional>) @ 0x0000000034413473 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderCompact.cpp:234: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x0000000034411539 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 2024.10.22 00:32:07.339674 [ 11846 ] {02366_3} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 33380216 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION range(modulo(number, 1000) :: 2) -> range(modulo(number, 1000)) Array(UInt16) : 1'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d62cacc in /usr/bin/clickhouse 10. COW::immutable_ptr DB::FunctionRange::executeInternal(DB::IColumn const*) const @ 0x000000001d4a83e5 in /usr/bin/clickhouse 11. DB::FunctionRange::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001d49a80d in /usr/bin/clickhouse 12. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.340023 [ 11330 ] {02366_4} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 33380216 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION range(modulo(number, 1000) :: 2) -> range(modulo(number, 1000)) Array(UInt16) : 1'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d62cacc in /usr/bin/clickhouse 10. COW::immutable_ptr DB::FunctionRange::executeInternal(DB::IColumn const*) const @ 0x000000001d4a83e5 in /usr/bin/clickhouse 11. DB::FunctionRange::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001d49a80d in /usr/bin/clickhouse 12. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.340508 [ 3096 ] {690ae707-4e30-40da-b4dc-f04098b7696d} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/udp/qozomzdvuutiuqpgnugjhhaqosmri, hash key: 81b9a47ffc393049b667a3c7f8228582, file_offset_of_buffer_end: 0, read_until_position: 347335, internal buffer end: 347335, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 690ae707-4e30-40da-b4dc-f04098b7696d:3254, file segment info: File segment: [0, 347334], key: 81b9a47ffc393049b667a3c7f8228582, state: DOWNLOADING, downloaded size: 0, reserved size: 347335, downloader id: 690ae707-4e30-40da-b4dc-f04098b7696d:3254, current write offset: 0, caller id: 690ae707-4e30-40da-b4dc-f04098b7696d:3254, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.340526 [ 2559 ] {c14ae281-2992-4e4a-8f85-e2f3d428244d} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44560) (comment: 01055_window_view_proc_hop_to.sh) (in query: CREATE TABLE dst (`count` UInt64) ENGINE = MergeTree ORDER BY tuple() SETTINGS index_granularity = 44238, min_bytes_for_wide_part = 0, ratio_of_defaults_for_sparse_serialization = 0.8560453653335571, merge_max_block_size = 11466, prefer_fetch_merged_part_size_threshold = 1, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 1, index_granularity_bytes = 4416630, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 42840, primary_key_compress_block_size = 15449), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 31. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 2024.10.22 00:32:07.340638 [ 11326 ] {02366_2} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 2097216 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory>::resize(unsigned long) @ 0x000000001d74f0a4 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:192: DB::BufferWithOutsideMemory::nextImpl() @ 0x00000000354600fe in /usr/bin/clickhouse 11. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000bdd68e8 in /usr/bin/clickhouse 12. void DB::detail::writeUIntTextFallback(unsigned short, DB::WriteBuffer&) @ 0x000000000c697b9b in /usr/bin/clickhouse 13. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:514: DB::SerializationArray::serializeTextJSON(DB::IColumn const&, unsigned long, DB::WriteBuffer&, DB::FormatSettings const&) const @ 0x000000002f166605 in /usr/bin/clickhouse 14. ./build_docker/./src/Formats/JSONUtils.cpp:431: DB::JSONUtils::writeFieldFromColumn(DB::IColumn const&, DB::ISerialization const&, unsigned long, bool, DB::FormatSettings const&, DB::WriteBuffer&, std::optional const&, unsigned long, char const*, bool) @ 0x000000003534ec82 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Formats/Impl/JSONEachRowRowOutputFormat.cpp:29: DB::JSONEachRowRowOutputFormat::writeField(DB::IColumn const&, DB::ISerialization const&, unsigned long) @ 0x000000003539f54d in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Formats/IRowOutputFormat.cpp:0: DB::IRowOutputFormat::write(std::vector::immutable_ptr, std::allocator::immutable_ptr>> const&, unsigned long) @ 0x0000000035040ca2 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Formats/IRowOutputFormat.cpp:32: DB::IRowOutputFormat::consume(DB::Chunk) @ 0x000000003504027b in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:613: DB::RowOutputFormatWithExceptionHandlerAdaptor, bool>::consume(DB::Chunk) @ 0x0000000035386814 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:613: DB::ParallelFormattingOutputFormat::formatterThreadFunction(unsigned long, unsigned long, std::shared_ptr const&) @ 0x000000003545b52b in /usr/bin/clickhouse 20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 21. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 24. ? @ 0x00007f11b339dac3 in ? 25. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.340773 [ 11386 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.340356 [ 11325 ] {02366_5} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.44 GiB (attempt to allocate chunk of 33380216 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION range(modulo(number, 1000) :: 2) -> range(modulo(number, 1000)) Array(UInt16) : 1'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d62cacc in /usr/bin/clickhouse 10. COW::immutable_ptr DB::FunctionRange::executeInternal(DB::IColumn const*) const @ 0x000000001d4a83e5 in /usr/bin/clickhouse 11. DB::FunctionRange::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001d49a80d in /usr/bin/clickhouse 12. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.342343 [ 11331 ] {02366_7} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 33380216 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION range(modulo(number, 1000) :: 2) -> range(modulo(number, 1000)) Array(UInt16) : 1'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d62cacc in /usr/bin/clickhouse 10. COW::immutable_ptr DB::FunctionRange::executeInternal(DB::IColumn const*) const @ 0x000000001d4a83e5 in /usr/bin/clickhouse 11. DB::FunctionRange::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001d49a80d in /usr/bin/clickhouse 12. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.343474 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1993342 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::SerializationArray::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f15c29f in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedColumnOnlyOutputStream.cpp:35: DB::MergedColumnOnlyOutputStream::MergedColumnOnlyOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::Block const&, std::shared_ptr, std::vector, std::allocator>> const&, std::set, std::allocator>*, DB::MergeTreeIndexGranularity const&, DB::MergeTreeIndexGranularityInfo const*) @ 0x00000000345d4876 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTask::VerticalMergeStage::prepareVerticalMergeForOneColumn() const @ 0x0000000033ea317a in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba8d8 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::VerticalMergeStage::execute() @ 0x0000000033eabd39 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.340225 [ 11886 ] {02366_6} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44570) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_6.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ParallelFormattingOutputFormat::formatterThreadFunction(unsigned long, unsigned long, std::shared_ptr const&) @ 0x000000003545a796 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 11. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.468947 [ 11891 ] {02366_8} executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44574) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_8.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.470073 [ 11885 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.474444 [ 11978 ] {02366_9} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 33380216 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION range(modulo(number, 1000) :: 2) -> range(modulo(number, 1000)) Array(UInt16) : 1'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d62cacc in /usr/bin/clickhouse 10. COW::immutable_ptr DB::FunctionRange::executeInternal(DB::IColumn const*) const @ 0x000000001d4a83e5 in /usr/bin/clickhouse 11. DB::FunctionRange::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001d49a80d in /usr/bin/clickhouse 12. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.474520 [ 3735 ] {02366_10} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 33380216 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION range(modulo(number, 1000) :: 2) -> range(modulo(number, 1000)) Array(UInt16) : 1'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d62cacc in /usr/bin/clickhouse 10. COW::immutable_ptr DB::FunctionRange::executeInternal(DB::IColumn const*) const @ 0x000000001d4a83e5 in /usr/bin/clickhouse 11. DB::FunctionRange::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001d49a80d in /usr/bin/clickhouse 12. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.474591 [ 3096 ] {690ae707-4e30-40da-b4dc-f04098b7696d} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/ius/bjivdipvygethnvguwhgksqrywvkx, hash key: 35305268ef77583b438ef905fb2c3b98, file_offset_of_buffer_end: 0, read_until_position: 26996, internal buffer end: 26996, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 690ae707-4e30-40da-b4dc-f04098b7696d:3236, file segment info: File segment: [0, 26995], key: 35305268ef77583b438ef905fb2c3b98, state: DOWNLOADING, downloaded size: 0, reserved size: 26996, downloader id: 690ae707-4e30-40da-b4dc-f04098b7696d:3236, current write offset: 0, caller id: 690ae707-4e30-40da-b4dc-f04098b7696d:3236, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.474658 [ 2559 ] {c14ae281-2992-4e4a-8f85-e2f3d428244d} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 31. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 2024.10.22 00:32:07.475230 [ 11886 ] {02366_6} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ParallelFormattingOutputFormat::formatterThreadFunction(unsigned long, unsigned long, std::shared_ptr const&) @ 0x000000003545a796 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 11. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.475216 [ 11851 ] {02366_1} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 2097216 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory>::resize(unsigned long) @ 0x000000001d74f0a4 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:192: DB::BufferWithOutsideMemory::nextImpl() @ 0x00000000354600fe in /usr/bin/clickhouse 11. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000bdd68e8 in /usr/bin/clickhouse 12. void DB::detail::writeUIntTextFallback(unsigned short, DB::WriteBuffer&) @ 0x000000000c697b9b in /usr/bin/clickhouse 13. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:514: DB::SerializationArray::serializeTextJSON(DB::IColumn const&, unsigned long, DB::WriteBuffer&, DB::FormatSettings const&) const @ 0x000000002f166605 in /usr/bin/clickhouse 14. ./build_docker/./src/Formats/JSONUtils.cpp:431: DB::JSONUtils::writeFieldFromColumn(DB::IColumn const&, DB::ISerialization const&, unsigned long, bool, DB::FormatSettings const&, DB::WriteBuffer&, std::optional const&, unsigned long, char const*, bool) @ 0x000000003534ec82 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Formats/Impl/JSONEachRowRowOutputFormat.cpp:29: DB::JSONEachRowRowOutputFormat::writeField(DB::IColumn const&, DB::ISerialization const&, unsigned long) @ 0x000000003539f54d in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Formats/IRowOutputFormat.cpp:0: DB::IRowOutputFormat::write(std::vector::immutable_ptr, std::allocator::immutable_ptr>> const&, unsigned long) @ 0x0000000035040ca2 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Formats/IRowOutputFormat.cpp:32: DB::IRowOutputFormat::consume(DB::Chunk) @ 0x000000003504027b in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:613: DB::RowOutputFormatWithExceptionHandlerAdaptor, bool>::consume(DB::Chunk) @ 0x0000000035386814 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:613: DB::ParallelFormattingOutputFormat::formatterThreadFunction(unsigned long, unsigned long, std::shared_ptr const&) @ 0x000000003545b52b in /usr/bin/clickhouse 20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 21. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 24. ? @ 0x00007f11b339dac3 in ? 25. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.475611 [ 11915 ] {0829c6b1-b48a-48fc-b223-9f7cd9a2fc0c} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 4194370 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing SynchronousQueryKiller. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44690) (comment: 02366_cancel_write_into_file.sh) (in query: kill query where startsWith(query_id, '02366_') sync), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory>::resize(unsigned long) @ 0x000000001d74f0a4 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:192: DB::BufferWithOutsideMemory::nextImpl() @ 0x00000000354600fe in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBuffer.h:0: DB::SerializationArray::serializeTextJSON(DB::IColumn const&, unsigned long, DB::WriteBuffer&, DB::FormatSettings const&) const @ 0x000000002f166532 in /usr/bin/clickhouse 12. ./build_docker/./src/Formats/JSONUtils.cpp:431: DB::JSONUtils::writeFieldFromColumn(DB::IColumn const&, DB::ISerialization const&, unsigned long, bool, DB::FormatSettings const&, DB::WriteBuffer&, std::optional const&, unsigned long, char const*, bool) @ 0x000000003534ec82 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Formats/Impl/JSONEachRowRowOutputFormat.cpp:29: DB::JSONEachRowRowOutputFormat::writeField(DB::IColumn const&, DB::ISerialization const&, unsigned long) @ 0x000000003539f54d in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Formats/IRowOutputFormat.cpp:0: DB::IRowOutputFormat::write(std::vector::immutable_ptr, std::allocator::immutable_ptr>> const&, unsigned long) @ 0x0000000035040ca2 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Formats/IRowOutputFormat.cpp:32: DB::IRowOutputFormat::consume(DB::Chunk) @ 0x000000003504027b in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:613: DB::RowOutputFormatWithExceptionHandlerAdaptor, bool>::consume(DB::Chunk) @ 0x0000000035386814 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:613: DB::ParallelFormattingOutputFormat::formatterThreadFunction(unsigned long, unsigned long, std::shared_ptr const&) @ 0x000000003545b52b in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 19. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.482173 [ 11406 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.489015 [ 2049 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.489332 [ 1975 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.490394 [ 11852 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.495899 [ 11915 ] {0829c6b1-b48a-48fc-b223-9f7cd9a2fc0c} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 4194370 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing SynchronousQueryKiller. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory>::resize(unsigned long) @ 0x000000001d74f0a4 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:192: DB::BufferWithOutsideMemory::nextImpl() @ 0x00000000354600fe in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBuffer.h:0: DB::SerializationArray::serializeTextJSON(DB::IColumn const&, unsigned long, DB::WriteBuffer&, DB::FormatSettings const&) const @ 0x000000002f166532 in /usr/bin/clickhouse 12. ./build_docker/./src/Formats/JSONUtils.cpp:431: DB::JSONUtils::writeFieldFromColumn(DB::IColumn const&, DB::ISerialization const&, unsigned long, bool, DB::FormatSettings const&, DB::WriteBuffer&, std::optional const&, unsigned long, char const*, bool) @ 0x000000003534ec82 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Formats/Impl/JSONEachRowRowOutputFormat.cpp:29: DB::JSONEachRowRowOutputFormat::writeField(DB::IColumn const&, DB::ISerialization const&, unsigned long) @ 0x000000003539f54d in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Formats/IRowOutputFormat.cpp:0: DB::IRowOutputFormat::write(std::vector::immutable_ptr, std::allocator::immutable_ptr>> const&, unsigned long) @ 0x0000000035040ca2 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Formats/IRowOutputFormat.cpp:32: DB::IRowOutputFormat::consume(DB::Chunk) @ 0x000000003504027b in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:613: DB::RowOutputFormatWithExceptionHandlerAdaptor, bool>::consume(DB::Chunk) @ 0x0000000035386814 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:613: DB::ParallelFormattingOutputFormat::formatterThreadFunction(unsigned long, unsigned long, std::shared_ptr const&) @ 0x000000003545b52b in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 19. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.502271 [ 2066 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.502249 [ 3740 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.502189 [ 2040 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.503277 [ 2074 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.504868 [ 3746 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.505311 [ 2099 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.510422 [ 11357 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.47 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.508710 [ 3096 ] {690ae707-4e30-40da-b4dc-f04098b7696d} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/tzz/wgqiyqnlrdwwzwprzkbdrrstlonlk, hash key: 5e4fd76ebd8cb1d37baebfb22cb370eb, file_offset_of_buffer_end: 0, read_until_position: 367600, internal buffer end: 367600, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 690ae707-4e30-40da-b4dc-f04098b7696d:4469, file segment info: File segment: [0, 367599], key: 5e4fd76ebd8cb1d37baebfb22cb370eb, state: DOWNLOADING, downloaded size: 0, reserved size: 367600, downloader id: 690ae707-4e30-40da-b4dc-f04098b7696d:4469, current write offset: 0, caller id: 690ae707-4e30-40da-b4dc-f04098b7696d:4469, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.513754 [ 11891 ] {02366_8} TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:07.519397 [ 11854 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.51 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.638313 [ 3096 ] {690ae707-4e30-40da-b4dc-f04098b7696d} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/kzr/vxcujugsxjhtnoteirmntlnsuvaif, hash key: 8823e75cefb1c51b12abdb34d7bf50f9, file_offset_of_buffer_end: 0, read_until_position: 24850, internal buffer end: 24850, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 690ae707-4e30-40da-b4dc-f04098b7696d:7098, file segment info: File segment: [0, 24849], key: 8823e75cefb1c51b12abdb34d7bf50f9, state: DOWNLOADING, downloaded size: 0, reserved size: 24850, downloader id: 690ae707-4e30-40da-b4dc-f04098b7696d:7098, current write offset: 0, caller id: 690ae707-4e30-40da-b4dc-f04098b7696d:7098, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.657257 [ 3096 ] {690ae707-4e30-40da-b4dc-f04098b7696d} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/irr/wsdhhjonwifdmxyyehdggqzzjdiiv, hash key: dd6a5b2d606f676028f7ab02781183fa, file_offset_of_buffer_end: 0, read_until_position: 464903, internal buffer end: 464903, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 690ae707-4e30-40da-b4dc-f04098b7696d:9423, file segment info: File segment: [0, 464902], key: dd6a5b2d606f676028f7ab02781183fa, state: DOWNLOADING, downloaded size: 0, reserved size: 464903, downloader id: 690ae707-4e30-40da-b4dc-f04098b7696d:9423, current write offset: 0, caller id: 690ae707-4e30-40da-b4dc-f04098b7696d:9423, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.848534 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {10cd912e-87f6-4680-9afb-58c2ab644105::all_0_29_2}: Code: 234. DB::Exception: No active replica has part all_0_29_2 or covering part (cannot execute queue-0000000034: MERGE_PARTS with virtual parts [all_0_29_2]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.849825 [ 3096 ] {690ae707-4e30-40da-b4dc-f04098b7696d} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/rqz/jbbzndwzrubxzbuqlvhydynprjrhn, hash key: bbead115dc729816ce51dff48de879ac, file_offset_of_buffer_end: 0, read_until_position: 207674, internal buffer end: 207674, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 690ae707-4e30-40da-b4dc-f04098b7696d:9569, file segment info: File segment: [0, 207673], key: bbead115dc729816ce51dff48de879ac, state: DOWNLOADING, downloaded size: 0, reserved size: 207674, downloader id: 690ae707-4e30-40da-b4dc-f04098b7696d:9569, current write offset: 0, caller id: 690ae707-4e30-40da-b4dc-f04098b7696d:9569, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:07.857286 [ 11388 ] {8a88dbf3-2284-4251-aa9b-44a34642c564} executeQuery: Code: 72. DB::ParsingException: Cannot parse number with multiple sign (+/-) characters: Cannot parse Int64 from String: While processing toInt64('++1'). (CANNOT_PARSE_NUMBER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44668) (comment: 01888_read_int_safe.sql) (in query: select toInt64('++1');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::ParsingException::ParsingException<>(int, FormatStringHelperImpl<>) @ 0x000000000be4f9b1 in /usr/bin/clickhouse 3. void DB::readIntTextImpl(long&, DB::ReadBuffer&) @ 0x000000000c1acd94 in /usr/bin/clickhouse 4. COW::immutable_ptr DB::ConvertThroughParsing, DB::NameToInt64, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c1ac05a in /usr/bin/clickhouse 5. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c18196d in /usr/bin/clickhouse 6. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17c9e6 in /usr/bin/clickhouse 7. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17a6aa in /usr/bin/clickhouse 8. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:32:07.927096 [ 11388 ] {8a88dbf3-2284-4251-aa9b-44a34642c564} TCPHandler: Code: 72. DB::ParsingException: Cannot parse number with multiple sign (+/-) characters: Cannot parse Int64 from String: While processing toInt64('++1'). (CANNOT_PARSE_NUMBER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::ParsingException::ParsingException<>(int, FormatStringHelperImpl<>) @ 0x000000000be4f9b1 in /usr/bin/clickhouse 3. void DB::readIntTextImpl(long&, DB::ReadBuffer&) @ 0x000000000c1acd94 in /usr/bin/clickhouse 4. COW::immutable_ptr DB::ConvertThroughParsing, DB::NameToInt64, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c1ac05a in /usr/bin/clickhouse 5. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c18196d in /usr/bin/clickhouse 6. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17c9e6 in /usr/bin/clickhouse 7. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17a6aa in /usr/bin/clickhouse 8. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:32:08.003889 [ 2843 ] {d4ec6780-c276-4457-a9dd-682d1baf37b9} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1062730 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::ColumnString::insert(DB::Field const&) @ 0x00000000326f278b in /usr/bin/clickhouse 11. ./build_docker/./src/Columns/IColumn.h:186: DB::IColumn::insertMany(DB::Field const&, unsigned long) @ 0x000000002d8acf39 in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IColumn::createWithOffsets(DB::PODArray, 63ul, 64ul> const&, DB::Field const&, unsigned long, unsigned long) const @ 0x0000000032bb7bd4 in /usr/bin/clickhouse 13. ./build_docker/./src/Columns/ColumnSparse.cpp:132: DB::ColumnSparse::convertToFullColumnIfSparse() const @ 0x00000000326c5cd7 in /usr/bin/clickhouse 14. ./build_docker/./src/Columns/ColumnSparse.cpp:0: DB::recursiveRemoveSparse(COW::immutable_ptr const&) @ 0x00000000326d1d3d in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdab0fc in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:08.034952 [ 3829 ] {eb3648e6-f2b2-4c8e-861e-54e509b12d95} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1388701 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/memcpySmall.h:40: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x00000000326f2a83 in /usr/bin/clickhouse 11. ./build_docker/./src/Columns/IColumn.cpp:0: DB::IColumn::createWithOffsets(DB::PODArray, 63ul, 64ul> const&, DB::Field const&, unsigned long, unsigned long) const @ 0x0000000032bb7c3d in /usr/bin/clickhouse 12. ./build_docker/./src/Columns/ColumnSparse.cpp:132: DB::ColumnSparse::convertToFullColumnIfSparse() const @ 0x00000000326c5cd7 in /usr/bin/clickhouse 13. ./build_docker/./src/Columns/ColumnSparse.cpp:0: DB::recursiveRemoveSparse(COW::immutable_ptr const&) @ 0x00000000326d1d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdab0fc in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 21. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 24. ? @ 0x00007f11b339dac3 in ? 25. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:08.038442 [ 3096 ] {690ae707-4e30-40da-b4dc-f04098b7696d} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/kof/nrptewxvvttauxmdnoujcsdksdrqj, hash key: fe920bb1ca0602ee06a072d2d9fcc3ba, file_offset_of_buffer_end: 0, read_until_position: 408001, internal buffer end: 408001, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 690ae707-4e30-40da-b4dc-f04098b7696d:2720, file segment info: File segment: [0, 408000], key: fe920bb1ca0602ee06a072d2d9fcc3ba, state: DOWNLOADING, downloaded size: 0, reserved size: 408001, downloader id: 690ae707-4e30-40da-b4dc-f04098b7696d:2720, current write offset: 0, caller id: 690ae707-4e30-40da-b4dc-f04098b7696d:2720, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:08.056697 [ 3096 ] {690ae707-4e30-40da-b4dc-f04098b7696d} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/nho/wwejscnwqxotsglxtnhdqtfwmfbog, hash key: 7705267d917aaa283217e5eb6296f610, file_offset_of_buffer_end: 0, read_until_position: 23539, internal buffer end: 23539, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 690ae707-4e30-40da-b4dc-f04098b7696d:6591, file segment info: File segment: [0, 23538], key: 7705267d917aaa283217e5eb6296f610, state: DOWNLOADING, downloaded size: 0, reserved size: 23539, downloader id: 690ae707-4e30-40da-b4dc-f04098b7696d:6591, current write offset: 0, caller id: 690ae707-4e30-40da-b4dc-f04098b7696d:6591, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:08.063716 [ 3096 ] {690ae707-4e30-40da-b4dc-f04098b7696d} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/ycz/zbuasvdqjrznzolikomfnhsgfphfc, hash key: f083235dd06e4cffa3cbb53544054daf, file_offset_of_buffer_end: 0, read_until_position: 305487, internal buffer end: 305487, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 690ae707-4e30-40da-b4dc-f04098b7696d:3289, file segment info: File segment: [0, 305486], key: f083235dd06e4cffa3cbb53544054daf, state: DOWNLOADING, downloaded size: 0, reserved size: 305487, downloader id: 690ae707-4e30-40da-b4dc-f04098b7696d:3289, current write offset: 0, caller id: 690ae707-4e30-40da-b4dc-f04098b7696d:3289, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:08.118252 [ 3096 ] {690ae707-4e30-40da-b4dc-f04098b7696d} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/xzw/zuqqsrjdrodpcwuebugtjhzfprjlo, hash key: ba008bff296ff774096f1f384b5099ca, file_offset_of_buffer_end: 0, read_until_position: 470596, internal buffer end: 470596, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 690ae707-4e30-40da-b4dc-f04098b7696d:3086, file segment info: File segment: [0, 470595], key: ba008bff296ff774096f1f384b5099ca, state: DOWNLOADING, downloaded size: 0, reserved size: 470596, downloader id: 690ae707-4e30-40da-b4dc-f04098b7696d:3086, current write offset: 0, caller id: 690ae707-4e30-40da-b4dc-f04098b7696d:3086, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:08.154915 [ 3096 ] {690ae707-4e30-40da-b4dc-f04098b7696d} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/kec/aigjwztgjjdpvxhizjtblpqtysofh, hash key: 1616a001c1975bbfaa6df922700e4556, file_offset_of_buffer_end: 0, read_until_position: 414820, internal buffer end: 414820, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 690ae707-4e30-40da-b4dc-f04098b7696d:9556, file segment info: File segment: [0, 414819], key: 1616a001c1975bbfaa6df922700e4556, state: DOWNLOADING, downloaded size: 0, reserved size: 414820, downloader id: 690ae707-4e30-40da-b4dc-f04098b7696d:9556, current write offset: 0, caller id: 690ae707-4e30-40da-b4dc-f04098b7696d:9556, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:08.203562 [ 11388 ] {d26604bb-b99b-4a01-ba00-b6d11e603d2a} executeQuery: Code: 72. DB::ParsingException: Cannot parse number with multiple sign (+/-) characters: Cannot parse Int64 from String: While processing toInt64('++'). (CANNOT_PARSE_NUMBER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44668) (comment: 01888_read_int_safe.sql) (in query: select toInt64('++');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::ParsingException::ParsingException<>(int, FormatStringHelperImpl<>) @ 0x000000000be4f9b1 in /usr/bin/clickhouse 3. void DB::readIntTextImpl(long&, DB::ReadBuffer&) @ 0x000000000c1acd94 in /usr/bin/clickhouse 4. COW::immutable_ptr DB::ConvertThroughParsing, DB::NameToInt64, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c1ac05a in /usr/bin/clickhouse 5. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c18196d in /usr/bin/clickhouse 6. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17c9e6 in /usr/bin/clickhouse 7. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17a6aa in /usr/bin/clickhouse 8. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:32:08.205979 [ 3096 ] {690ae707-4e30-40da-b4dc-f04098b7696d} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/eow/cqzyefonroyevqizmlzmwalxcmbnq, hash key: fd7e26a462ce62f1f0ffebfa8b535fb6, file_offset_of_buffer_end: 0, read_until_position: 311002, internal buffer end: 311002, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 690ae707-4e30-40da-b4dc-f04098b7696d:3078, file segment info: File segment: [0, 311001], key: fd7e26a462ce62f1f0ffebfa8b535fb6, state: DOWNLOADING, downloaded size: 0, reserved size: 311002, downloader id: 690ae707-4e30-40da-b4dc-f04098b7696d:3078, current write offset: 0, caller id: 690ae707-4e30-40da-b4dc-f04098b7696d:3078, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:08.221077 [ 11388 ] {d26604bb-b99b-4a01-ba00-b6d11e603d2a} TCPHandler: Code: 72. DB::ParsingException: Cannot parse number with multiple sign (+/-) characters: Cannot parse Int64 from String: While processing toInt64('++'). (CANNOT_PARSE_NUMBER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::ParsingException::ParsingException<>(int, FormatStringHelperImpl<>) @ 0x000000000be4f9b1 in /usr/bin/clickhouse 3. void DB::readIntTextImpl(long&, DB::ReadBuffer&) @ 0x000000000c1acd94 in /usr/bin/clickhouse 4. COW::immutable_ptr DB::ConvertThroughParsing, DB::NameToInt64, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c1ac05a in /usr/bin/clickhouse 5. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c18196d in /usr/bin/clickhouse 6. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17c9e6 in /usr/bin/clickhouse 7. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17a6aa in /usr/bin/clickhouse 8. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:32:08.250306 [ 3096 ] {690ae707-4e30-40da-b4dc-f04098b7696d} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/rbj/fhyjelfpcuaheymheejgwlxpmeybx, hash key: 16ea20669f6678839afccb7e486c7b03, file_offset_of_buffer_end: 0, read_until_position: 353819, internal buffer end: 353819, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 690ae707-4e30-40da-b4dc-f04098b7696d:4385, file segment info: File segment: [0, 353818], key: 16ea20669f6678839afccb7e486c7b03, state: DOWNLOADING, downloaded size: 0, reserved size: 353819, downloader id: 690ae707-4e30-40da-b4dc-f04098b7696d:4385, current write offset: 0, caller id: 690ae707-4e30-40da-b4dc-f04098b7696d:4385, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:08.298069 [ 3096 ] {690ae707-4e30-40da-b4dc-f04098b7696d} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/ozn/vikuzbjrwxuzzbwbaopxrflhfgmwd, hash key: 2eb03e46d507c545b5a4022e781cb371, file_offset_of_buffer_end: 0, read_until_position: 13250, internal buffer end: 13250, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 690ae707-4e30-40da-b4dc-f04098b7696d:3151, file segment info: File segment: [0, 13249], key: 2eb03e46d507c545b5a4022e781cb371, state: DOWNLOADING, downloaded size: 0, reserved size: 13250, downloader id: 690ae707-4e30-40da-b4dc-f04098b7696d:3151, current write offset: 0, caller id: 690ae707-4e30-40da-b4dc-f04098b7696d:3151, kind: Regular, unbound: 0: (while reading column SearchPhrase): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 37715): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:08.338718 [ 11418 ] {000fea9f-be32-49d8-b16d-345ef76e9403} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44758) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:08.354211 [ 11418 ] {000fea9f-be32-49d8-b16d-345ef76e9403} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:08.498921 [ 2039 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:08.503779 [ 2094 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:08.519580 [ 2068 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:08.519860 [ 2097 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:08.521506 [ 11976 ] {a3222321-3aba-4354-913b-7178836b7792} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41714) (comment: 00174_distinct_in_order.sql) (in query: CREATE DATABASE IF NOT EXISTS test_4pkk3u3r ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:08.521881 [ 2090 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:08.522016 [ 2045 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:08.538381 [ 11976 ] {a3222321-3aba-4354-913b-7178836b7792} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:08.689941 [ 11388 ] {dd19a56d-07f9-4710-ba94-17b4d59d71df} executeQuery: Code: 72. DB::ParsingException: Cannot parse number with a sign character but without any numeric character: Cannot parse Int64 from String: While processing toInt64('+'). (CANNOT_PARSE_NUMBER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44668) (comment: 01888_read_int_safe.sql) (in query: select toInt64('+');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::ParsingException::ParsingException<>(int, FormatStringHelperImpl<>) @ 0x000000000be4f9b1 in /usr/bin/clickhouse 3. void DB::readIntTextImpl(long&, DB::ReadBuffer&) @ 0x000000000c1acf66 in /usr/bin/clickhouse 4. COW::immutable_ptr DB::ConvertThroughParsing, DB::NameToInt64, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c1ac05a in /usr/bin/clickhouse 5. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c18196d in /usr/bin/clickhouse 6. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17c9e6 in /usr/bin/clickhouse 7. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17a6aa in /usr/bin/clickhouse 8. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:32:08.710976 [ 11388 ] {dd19a56d-07f9-4710-ba94-17b4d59d71df} TCPHandler: Code: 72. DB::ParsingException: Cannot parse number with a sign character but without any numeric character: Cannot parse Int64 from String: While processing toInt64('+'). (CANNOT_PARSE_NUMBER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::ParsingException::ParsingException<>(int, FormatStringHelperImpl<>) @ 0x000000000be4f9b1 in /usr/bin/clickhouse 3. void DB::readIntTextImpl(long&, DB::ReadBuffer&) @ 0x000000000c1acf66 in /usr/bin/clickhouse 4. COW::immutable_ptr DB::ConvertThroughParsing, DB::NameToInt64, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c1ac05a in /usr/bin/clickhouse 5. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c18196d in /usr/bin/clickhouse 6. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17c9e6 in /usr/bin/clickhouse 7. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17a6aa in /usr/bin/clickhouse 8. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:32:09.198915 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {10cd912e-87f6-4680-9afb-58c2ab644105::all_0_29_2}: Code: 234. DB::Exception: No active replica has part all_0_29_2 or covering part (cannot execute queue-0000000034: MERGE_PARTS with virtual parts [all_0_29_2]). (NO_REPLICA_HAS_PART), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&&) @ 0x000000002d8d7d9b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1940: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331e924c in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 5. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 9. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:09.199187 [ 11388 ] {1eacfe28-3b58-491c-9419-d51312ce69b0} executeQuery: Code: 6. DB::Exception: Cannot parse string '1+1' as Int64: syntax error at position 1 (parsed just '1'). Note: there are toInt64OrZero and toInt64OrNull functions, which returns zero/NULL instead of throwing exception.: While processing toInt64('1+1'). (CANNOT_PARSE_TEXT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44668) (comment: 01888_read_int_safe.sql) (in query: select toInt64('1+1');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000bdd57ee in /usr/bin/clickhouse 3. DB::throwExceptionForIncompletelyParsedValue(DB::ReadBuffer&, DB::IDataType const&) @ 0x000000000bdd4851 in /usr/bin/clickhouse 4. COW::immutable_ptr DB::ConvertThroughParsing, DB::NameToInt64, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c1ac3ff in /usr/bin/clickhouse 5. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c18196d in /usr/bin/clickhouse 6. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17c9e6 in /usr/bin/clickhouse 7. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17a6aa in /usr/bin/clickhouse 8. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:32:09.239861 [ 11388 ] {1eacfe28-3b58-491c-9419-d51312ce69b0} TCPHandler: Code: 6. DB::Exception: Cannot parse string '1+1' as Int64: syntax error at position 1 (parsed just '1'). Note: there are toInt64OrZero and toInt64OrNull functions, which returns zero/NULL instead of throwing exception.: While processing toInt64('1+1'). (CANNOT_PARSE_TEXT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000bdd57ee in /usr/bin/clickhouse 3. DB::throwExceptionForIncompletelyParsedValue(DB::ReadBuffer&, DB::IDataType const&) @ 0x000000000bdd4851 in /usr/bin/clickhouse 4. COW::immutable_ptr DB::ConvertThroughParsing, DB::NameToInt64, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c1ac3ff in /usr/bin/clickhouse 5. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c18196d in /usr/bin/clickhouse 6. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17c9e6 in /usr/bin/clickhouse 7. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17a6aa in /usr/bin/clickhouse 8. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:32:09.309819 [ 11388 ] {a6643016-75ca-4e56-9e48-eebc8db2f37b} executeQuery: Code: 6. DB::Exception: Cannot parse string '1-1' as Int64: syntax error at position 1 (parsed just '1'). Note: there are toInt64OrZero and toInt64OrNull functions, which returns zero/NULL instead of throwing exception.: While processing toInt64('1-1'). (CANNOT_PARSE_TEXT) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44668) (comment: 01888_read_int_safe.sql) (in query: select toInt64('1-1');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000bdd57ee in /usr/bin/clickhouse 3. DB::throwExceptionForIncompletelyParsedValue(DB::ReadBuffer&, DB::IDataType const&) @ 0x000000000bdd4851 in /usr/bin/clickhouse 4. COW::immutable_ptr DB::ConvertThroughParsing, DB::NameToInt64, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c1ac3ff in /usr/bin/clickhouse 5. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c18196d in /usr/bin/clickhouse 6. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17c9e6 in /usr/bin/clickhouse 7. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17a6aa in /usr/bin/clickhouse 8. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:32:09.332490 [ 11388 ] {a6643016-75ca-4e56-9e48-eebc8db2f37b} TCPHandler: Code: 6. DB::Exception: Cannot parse string '1-1' as Int64: syntax error at position 1 (parsed just '1'). Note: there are toInt64OrZero and toInt64OrNull functions, which returns zero/NULL instead of throwing exception.: While processing toInt64('1-1'). (CANNOT_PARSE_TEXT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000bdd57ee in /usr/bin/clickhouse 3. DB::throwExceptionForIncompletelyParsedValue(DB::ReadBuffer&, DB::IDataType const&) @ 0x000000000bdd4851 in /usr/bin/clickhouse 4. COW::immutable_ptr DB::ConvertThroughParsing, DB::NameToInt64, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c1ac3ff in /usr/bin/clickhouse 5. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c18196d in /usr/bin/clickhouse 6. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17c9e6 in /usr/bin/clickhouse 7. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17a6aa in /usr/bin/clickhouse 8. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:32:09.510989 [ 2085 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:09.513565 [ 2012 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:09.521517 [ 11845 ] {807703fc-8ea0-421e-a3cc-b78a8df0283b} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56876) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:09.737946 [ 1975 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:09.738053 [ 1993 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:09.738128 [ 2049 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:09.738191 [ 11845 ] {807703fc-8ea0-421e-a3cc-b78a8df0283b} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:09.738478 [ 2074 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:09.739038 [ 11388 ] {18b0e51e-3d45-444c-89cf-db8c8eecc275} executeQuery: Code: 32. DB::Exception: Attempt to read after eof: Cannot parse Int64 from String, because value is too short: While processing toInt64(''). (ATTEMPT_TO_READ_AFTER_EOF) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44668) (comment: 01888_read_int_safe.sql) (in query: select toInt64('');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [26]) @ 0x000000000c5ee509 in /usr/bin/clickhouse 3. ./build_docker/./src/IO/VarInt.cpp:13: DB::throwReadAfterEOF() @ 0x000000001d75d07e in /usr/bin/clickhouse 4. void DB::readIntTextImpl(long&, DB::ReadBuffer&) @ 0x000000000c1acfda in /usr/bin/clickhouse 5. COW::immutable_ptr DB::ConvertThroughParsing, DB::NameToInt64, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c1ac05a in /usr/bin/clickhouse 6. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c18196d in /usr/bin/clickhouse 7. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17c9e6 in /usr/bin/clickhouse 8. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17a6aa in /usr/bin/clickhouse 9. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 10. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 2024.10.22 00:32:09.918594 [ 11388 ] {18b0e51e-3d45-444c-89cf-db8c8eecc275} TCPHandler: Code: 32. DB::Exception: Attempt to read after eof: Cannot parse Int64 from String, because value is too short: While processing toInt64(''). (ATTEMPT_TO_READ_AFTER_EOF), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [26]) @ 0x000000000c5ee509 in /usr/bin/clickhouse 3. ./build_docker/./src/IO/VarInt.cpp:13: DB::throwReadAfterEOF() @ 0x000000001d75d07e in /usr/bin/clickhouse 4. void DB::readIntTextImpl(long&, DB::ReadBuffer&) @ 0x000000000c1acfda in /usr/bin/clickhouse 5. COW::immutable_ptr DB::ConvertThroughParsing, DB::NameToInt64, (DB::ConvertFromStringExceptionMode)0, (DB::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c1ac05a in /usr/bin/clickhouse 6. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c18196d in /usr/bin/clickhouse 7. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17c9e6 in /usr/bin/clickhouse 8. DB::FunctionConvert, DB::NameToInt64, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c17a6aa in /usr/bin/clickhouse 9. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 10. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 13. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 2024.10.22 00:32:09.973898 [ 11853 ] {896a3aaf-9d9d-46b2-a19a-a1575ac90610} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1310783 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/jgc/gmqvavsfzfamzcvxbqbvtuooffylt, hash key: dd1322564f7993952073594112a2286a, file_offset_of_buffer_end: 0, read_until_position: 1099712, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 896a3aaf-9d9d-46b2-a19a-a1575ac90610:18507, file segment info: File segment: [0, 1099711], key: dd1322564f7993952073594112a2286a, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 896a3aaf-9d9d-46b2-a19a-a1575ac90610:18507, current write offset: 0, caller id: 896a3aaf-9d9d-46b2-a19a-a1575ac90610:18507, kind: Regular, unbound: 0: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_14_14_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:44790) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format CSV ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/tuple:533: DB::AsynchronousBoundedReadBuffer::nextImpl() @ 0x000000002dd1f0ef in /usr/bin/clickhouse 20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x000000002ec749b2 in /usr/bin/clickhouse 21. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec795a1 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f2182b0 in /usr/bin/clickhouse 23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 2024.10.22 00:32:09.985808 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.258752 [ 2197 ] {ea76b663-69ca-44ae-8ea1-6288fdb6328d::all_1_1_0_2} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.53 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.285608 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 5030374 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.383180 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd965a38d-b6da-479e-ba33-adc89af01947' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:10.605398 [ 11849 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.605996 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 4710398 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031cccb46 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d9693f9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.726508 [ 2102 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.726592 [ 3510 ] {65fbe7c5-bdc3-418e-96ce-bd061f121730} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41772) (comment: 00074_full_join.sql) (in query: CREATE DATABASE IF NOT EXISTS test_w0elm379 ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:10.726480 [ 2570 ] {69ae271a-cd74-47ce-a74d-ace6ee56a4cf} executeQuery: Code: 341. DB::Exception: Exception happened during execution of mutation 'mutation_2.txt' with part 'all_1_1_0' reason: 'Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.53 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build))'. This error maybe retryable or not. In case of unretryable error, mutation can be killed with KILL MUTATION query. (UNFINISHED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56860) (comment: 01162_strange_mutations.sh) (in query: alter table t delete where n global in (select * from (select * from t where n global in (1::Int32)))), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, String&&, String&, String&) @ 0x00000000343bf960 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeMutationStatus.cpp:26: DB::checkMutationStatus(std::optional&, std::set, std::allocator> const&) @ 0x00000000343bf397 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageMergeTree.cpp:0: DB::StorageMergeTree::waitForMutation(long, String const&, bool) @ 0x000000003490eaa1 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::StorageMergeTree::mutate(DB::MutationCommands const&, std::shared_ptr) @ 0x0000000034910f59 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112be20 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:10.727088 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1081503 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_8_8_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd8d085 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f21ac06 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 29. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.726884 [ 1986 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.727292 [ 2209 ] {} test_9.r2 (b6425a76-1577-4794-961d-2e29f5f2f5ac): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.727397 [ 11443 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.727718 [ 3885 ] {02366_1} executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44702) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_1.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=0), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:10.727792 [ 2213 ] {} test_9.r3 (62491bdd-3081-4b4a-83f6-3b90fdfbbd4b): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.727898 [ 2197 ] {ea76b663-69ca-44ae-8ea1-6288fdb6328d::all_1_1_0_2} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.53 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.728217 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.731876 [ 2210 ] {} test_9.r2 (b6425a76-1577-4794-961d-2e29f5f2f5ac): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.731858 [ 2212 ] {} test_9.r2 (b6425a76-1577-4794-961d-2e29f5f2f5ac): auto DB::StorageReplicatedMergeTree::processQueueEntry(ReplicatedMergeTreeQueue::SelectedEntryPtr)::(anonymous class)::operator()(LogEntryPtr &) const: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1794: DB::StorageReplicatedMergeTree::executeLogEntry(DB::ReplicatedMergeTreeLogEntry&) @ 0x00000000331b5d1b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker&)>::__call_impl)::$_1, bool (std::shared_ptr&)>>(std::__function::__policy_storage const*, std::shared_ptr&) @ 0x0000000033450bb1 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:1766: DB::ReplicatedMergeTreeQueue::processEntry(std::function ()>, std::shared_ptr&, std::function&)>) @ 0x00000000347d4821 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::processQueueEntry(std::shared_ptr) @ 0x000000003327bf4f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/IExecutableTask.h:61: DB::ExecutableLambdaAdapter::executeStep() @ 0x00000000334baab4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ed8836 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033eda4c6 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.732617 [ 11845 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.734075 [ 11392 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.735542 [ 2570 ] {69ae271a-cd74-47ce-a74d-ace6ee56a4cf} TCPHandler: Code: 341. DB::Exception: Exception happened during execution of mutation 'mutation_2.txt' with part 'all_1_1_0' reason: 'Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.53 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build))'. This error maybe retryable or not. In case of unretryable error, mutation can be killed with KILL MUTATION query. (UNFINISHED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, String&&, String&, String&) @ 0x00000000343bf960 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeMutationStatus.cpp:26: DB::checkMutationStatus(std::optional&, std::set, std::allocator> const&) @ 0x00000000343bf397 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageMergeTree.cpp:0: DB::StorageMergeTree::waitForMutation(long, String const&, bool) @ 0x000000003490eaa1 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::StorageMergeTree::mutate(DB::MutationCommands const&, std::shared_ptr) @ 0x0000000034910f59 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112be20 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:10.739299 [ 3510 ] {65fbe7c5-bdc3-418e-96ce-bd061f121730} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.741500 [ 2052 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.742184 [ 2000 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.742836 [ 2050 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.743523 [ 2081 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:10.827658 [ 11363 ] {02366_10} executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44692) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_10.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=0), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:10.836875 [ 11363 ] {02366_10} TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:10.847677 [ 11378 ] {b3769de4-e222-430f-b92c-99b3c739dad5} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56942) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:10.850918 [ 11378 ] {b3769de4-e222-430f-b92c-99b3c739dad5} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:10.919020 [ 3885 ] {02366_1} TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:11.313572 [ 11853 ] {896a3aaf-9d9d-46b2-a19a-a1575ac90610} DynamicQueryHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1310783 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/jgc/gmqvavsfzfamzcvxbqbvtuooffylt, hash key: dd1322564f7993952073594112a2286a, file_offset_of_buffer_end: 0, read_until_position: 1099712, internal buffer end: 1048576, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 896a3aaf-9d9d-46b2-a19a-a1575ac90610:18507, file segment info: File segment: [0, 1099711], key: dd1322564f7993952073594112a2286a, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 896a3aaf-9d9d-46b2-a19a-a1575ac90610:18507, current write offset: 0, caller id: 896a3aaf-9d9d-46b2-a19a-a1575ac90610:18507, kind: Regular, unbound: 0: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_14_14_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/tuple:533: DB::AsynchronousBoundedReadBuffer::nextImpl() @ 0x000000002dd1f0ef in /usr/bin/clickhouse 20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x000000002ec749b2 in /usr/bin/clickhouse 21. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec795a1 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f2182b0 in /usr/bin/clickhouse 23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:11.733749 [ 2008 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:11.734765 [ 2084 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:11.744016 [ 2078 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:11.746791 [ 2070 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:11.748143 [ 2016 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:11.748172 [ 2026 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:11.880645 [ 2611 ] {02366_2} executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44714) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_2.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=0), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:11.899352 [ 11355 ] {f0fd50d1-1186-4ea2-9a36-0686d15e7d62} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56960) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:11.924857 [ 11355 ] {f0fd50d1-1186-4ea2-9a36-0686d15e7d62} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:12.145704 [ 11344 ] {02366_3} executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44732) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_3.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=0), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:12.170396 [ 11344 ] {02366_3} TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:12.346269 [ 11842 ] {02366_7} executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44718) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_7.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=0), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:12.349505 [ 3748 ] {02366_6} executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44788) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_6.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=0), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:12.367296 [ 3748 ] {02366_6} TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:12.438937 [ 2611 ] {02366_2} TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:12.443990 [ 11842 ] {02366_7} TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:12.444755 [ 11392 ] {5a9ed71c-d63b-449d-b7b3-8f31325c6497} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35258) (comment: 00073_uniq_array.sql) (in query: CREATE DATABASE IF NOT EXISTS test_4rsesxqy ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:12.469498 [ 11392 ] {5a9ed71c-d63b-449d-b7b3-8f31325c6497} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:12.496147 [ 11418 ] {247cf668-d825-4874-a4fa-85ada870c148} executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 276.40 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56882) (comment: 00141_transform.sql) (in query: SELECT transform(SearchEngineID, [2, 3], ['Яндекс', 'Google'], 'Остальные') AS title, count() AS c FROM test.hits WHERE SearchEngineID != 0 GROUP BY title HAVING c > 0 ORDER BY c DESC LIMIT 10;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:12.735516 [ 1988 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:12.740590 [ 2019 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:12.750988 [ 2077 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:12.751314 [ 1977 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:12.752453 [ 1980 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:12.760583 [ 2038 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:13.012515 [ 11843 ] {3ddc8b97-cec2-456e-bafc-e0d66b82746c} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57004) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:13.019300 [ 11843 ] {3ddc8b97-cec2-456e-bafc-e0d66b82746c} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:13.107207 [ 11418 ] {247cf668-d825-4874-a4fa-85ada870c148} TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 276.40 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x000000001d611345 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f540 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:13.179887 [ 13865 ] {02366_8} executeQuery: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44780) (comment: 02366_cancel_write_into_file.sh) (in query: insert into function file('02366_data_8.jsonl') select range(number % 1000) from numbers(100000) settings output_format_parallel_formatting=0), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:13.437258 [ 13865 ] {02366_8} TCPHandler: Code: 394. DB::Exception: Query was cancelled. (QUERY_WAS_CANCELLED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/ProcessList.cpp:463: DB::QueryStatus::checkTimeLimit() @ 0x000000003188adb6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::finalizeExecution() @ 0x0000000034ffd7b4 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcea0 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:13.740528 [ 2080 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:13.755642 [ 2056 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:13.758542 [ 2009 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:13.763870 [ 2020 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:13.764950 [ 2032 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:13.766591 [ 2051 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:14.092618 [ 11392 ] {f5ff5054-9f21-42da-9829-33cbf70f473b} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57026) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:14.102332 [ 11392 ] {f5ff5054-9f21-42da-9829-33cbf70f473b} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:14.231165 [ 11853 ] {3ee49b08-742e-462c-b49a-d30d027bba18} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35280) (comment: 00175_counting_resources_in_subqueries.sql) (in query: CREATE DATABASE IF NOT EXISTS test_70zyrqey ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:14.233325 [ 11853 ] {3ee49b08-742e-462c-b49a-d30d027bba18} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:14.234972 [ 11392 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:14.500263 [ 11416 ] {07416ded-e2e1-44bf-bb84-fed27f150924} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1245312 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_16_16_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:49566) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format CSV ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89205 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:14.742451 [ 2097 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:14.757441 [ 2011 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:14.760294 [ 2094 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:14.767760 [ 2068 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:14.771802 [ 1990 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:14.773324 [ 2090 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:15.106294 [ 11359 ] {b09c1ec1-ba54-4db9-9d10-3d543a3dd161} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35344) (comment: 00157_cache_dictionary.sql) (in query: CREATE DATABASE IF NOT EXISTS test_nku0ryho ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:15.114664 [ 11359 ] {b09c1ec1-ba54-4db9-9d10-3d543a3dd161} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:15.261146 [ 11417 ] {f1f7e2b6-b18b-4d2f-8ecb-c2f87779d81e} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57066) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:15.284115 [ 11417 ] {f1f7e2b6-b18b-4d2f-8ecb-c2f87779d81e} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:15.757335 [ 2023 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:15.767405 [ 1992 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:15.769066 [ 2007 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:15.787387 [ 2037 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:15.788303 [ 2801 ] {02fd4d4b-c02a-4358-822f-fdb6d8de8e58} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35368) (comment: 00038_uniq_state_merge2.sql) (in query: CREATE DATABASE IF NOT EXISTS test_16k0ykux ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:15.788561 [ 2001 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:15.788389 [ 1995 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:15.794336 [ 2801 ] {02fd4d4b-c02a-4358-822f-fdb6d8de8e58} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:16.401551 [ 11359 ] {2a0d2a6a-dccb-469b-af5c-28c3be4f4f13} executeQuery: Code: 36. DB::Exception: Too many groups for analysis of variance (should be no more than 1048576, got 18446744073709551615): While executing AggregatingTransform. (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57094) (comment: 02874_analysis_of_variance_overflow.sql) (in query: SELECT analysisOfVariance(1, 18446744073709551615);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, unsigned long const&, unsigned long&) @ 0x000000000cd1595d in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/Moments.h:463: DB::AnalysisOfVarianceMoments::add(double, unsigned long) @ 0x000000002650779e in /usr/bin/clickhouse 4. ./build_docker/./src/AggregateFunctions/IAggregateFunction.h:541: DB::IAggregateFunctionHelper::addBatchSinglePlace(unsigned long, unsigned long, char*, DB::IColumn const**, DB::Arena*, long) const @ 0x0000000026504cea in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::executeWithoutKeyImpl(char*&, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, DB::Arena*) const @ 0x000000002ff6dead in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/Aggregator.cpp:1586: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdabcb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:16.401829 [ 11417 ] {ef0369cc-2107-4456-bd2e-f5d66c0c2a49} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57108) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:16.402599 [ 11416 ] {07416ded-e2e1-44bf-bb84-fed27f150924} DynamicQueryHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1245312 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientEventTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_16_16_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 32768): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89205 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:16.415489 [ 11417 ] {ef0369cc-2107-4456-bd2e-f5d66c0c2a49} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:16.402593 [ 3747 ] {c15c0347-f64f-458a-928e-e736a7bef982} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35396) (comment: 00084_external_aggregation.sql) (in query: CREATE DATABASE IF NOT EXISTS test_wdfxwsj4 ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:16.525289 [ 11359 ] {2a0d2a6a-dccb-469b-af5c-28c3be4f4f13} TCPHandler: Code: 36. DB::Exception: Too many groups for analysis of variance (should be no more than 1048576, got 18446744073709551615): While executing AggregatingTransform. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, unsigned long const&, unsigned long&) @ 0x000000000cd1595d in /usr/bin/clickhouse 3. ./build_docker/./src/AggregateFunctions/Moments.h:463: DB::AnalysisOfVarianceMoments::add(double, unsigned long) @ 0x000000002650779e in /usr/bin/clickhouse 4. ./build_docker/./src/AggregateFunctions/IAggregateFunction.h:541: DB::IAggregateFunctionHelper::addBatchSinglePlace(unsigned long, unsigned long, char*, DB::IColumn const**, DB::Arena*, long) const @ 0x0000000026504cea in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::executeWithoutKeyImpl(char*&, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, DB::Arena*) const @ 0x000000002ff6dead in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/Aggregator.cpp:1586: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdabcb4 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 8. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 13. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:16.558912 [ 3747 ] {c15c0347-f64f-458a-928e-e736a7bef982} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:16.768439 [ 2103 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:16.770935 [ 2078 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:16.774441 [ 2070 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:16.795342 [ 2026 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:16.795817 [ 2079 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:16.796356 [ 1997 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:16.973745 [ 2801 ] {ed094c3b-869e-4ec7-9005-fa23b0112f53} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35434) (comment: 00056_view.sql) (in query: CREATE DATABASE IF NOT EXISTS test_pg2z20sj ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:16.978651 [ 2801 ] {ed094c3b-869e-4ec7-9005-fa23b0112f53} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:17.527976 [ 11866 ] {37a0ae32-c310-4267-89dc-1ab8e371f92f} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57166) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:17.545391 [ 11866 ] {37a0ae32-c310-4267-89dc-1ab8e371f92f} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:17.772891 [ 2017 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:17.778371 [ 2100 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:17.798296 [ 2104 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:17.799902 [ 2042 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:17.799990 [ 2018 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:17.872249 [ 2086 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:17.992896 [ 11400 ] {6acc6de7-d84e-41dd-bc64-29a1bd06c934} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35460) (comment: 00082_quantiles.sql) (in query: CREATE DATABASE IF NOT EXISTS test_nqc7a26j ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:17.994684 [ 11400 ] {6acc6de7-d84e-41dd-bc64-29a1bd06c934} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:18.629801 [ 11400 ] {e3bd6232-7483-4653-bb08-ba5ec2b40c3f} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35468) (comment: 00154_avro.sql) (in query: CREATE DATABASE IF NOT EXISTS test_ewy8gj1c ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:18.657892 [ 11400 ] {e3bd6232-7483-4653-bb08-ba5ec2b40c3f} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:18.682471 [ 11438 ] {566ef799-b849-471c-84d6-31a47a321741} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57206) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:18.701347 [ 11438 ] {566ef799-b849-471c-84d6-31a47a321741} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:18.804934 [ 2014 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:18.805539 [ 2052 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:18.805954 [ 2102 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:18.811815 [ 1986 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:18.814841 [ 2000 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:18.878283 [ 2047 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:19.652316 [ 1911 ] {8de3c3a6-39df-4092-a9de-e877649c4eb6} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35500) (comment: 00092_obfuscator.sh) (in query: CREATE DATABASE IF NOT EXISTS test_zu0dv0d9 ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:19.656458 [ 1911 ] {8de3c3a6-39df-4092-a9de-e877649c4eb6} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:19.754290 [ 11407 ] {c761fa03-c577-4fef-b58f-9eea2068b348} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46882) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:19.764095 [ 11407 ] {c761fa03-c577-4fef-b58f-9eea2068b348} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:19.819413 [ 2002 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:19.820396 [ 1987 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:19.832254 [ 2048 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:19.937869 [ 1984 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:19.943441 [ 2048 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:20.024482 [ 1978 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:20.436877 [ 1911 ] {ea9a815b-87d3-4b88-93c7-bbfc42fdee76} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:33534) (comment: 00172_early_constant_folding.sql) (in query: CREATE DATABASE IF NOT EXISTS test_dv1fzkvo ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:20.445251 [ 1911 ] {ea9a815b-87d3-4b88-93c7-bbfc42fdee76} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:20.822450 [ 2067 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:20.824699 [ 2040 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:20.845917 [ 1979 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:20.869022 [ 11438 ] {fe4d9022-99b2-4094-a900-70d7df67faf0} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46916) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:20.874427 [ 11438 ] {fe4d9022-99b2-4094-a900-70d7df67faf0} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:20.942028 [ 2027 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:20.950123 [ 2006 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:21.026426 [ 2020 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:21.290879 [ 1911 ] {5cce579f-26dd-4d62-9a60-078408141421} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:33544) (comment: 00159_parallel_formatting_tsv_and_friends.sh) (in query: CREATE DATABASE IF NOT EXISTS test_sswih6e9 ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:21.292967 [ 1911 ] {5cce579f-26dd-4d62-9a60-078408141421} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:21.824732 [ 2058 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:21.826259 [ 1989 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:21.847747 [ 2003 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:21.968230 [ 11424 ] {dc9ddc31-d4ac-4c1a-b174-689316031a76} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:33554) (comment: 00050_min_max.sql) (in query: CREATE DATABASE IF NOT EXISTS test_jfeytmzo ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:21.979406 [ 11424 ] {dc9ddc31-d4ac-4c1a-b174-689316031a76} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:22.016956 [ 2038 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:22.019022 [ 2057 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:22.028431 [ 2039 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:22.147838 [ 11389 ] {d988d9ff-b926-4d1d-b8ae-8b0ccb0746a5} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46946) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:22.159056 [ 11389 ] {d988d9ff-b926-4d1d-b8ae-8b0ccb0746a5} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:22.652175 [ 2479 ] {466bdb7a-c317-4217-a92a-c90008ee60c3} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:33572) (comment: 00089_position_functions_with_non_constant_arg.sql) (in query: CREATE DATABASE IF NOT EXISTS test_qrw9mz5c ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:22.657209 [ 2479 ] {466bdb7a-c317-4217-a92a-c90008ee60c3} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:22.826752 [ 2065 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:22.828259 [ 2060 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:22.849586 [ 2106 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:23.021254 [ 1995 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:23.021751 [ 2001 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:23.032907 [ 2054 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:23.169244 [ 11424 ] {ef03994d-db44-4cef-acbc-9fcac64d9860} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47022) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:23.191859 [ 11424 ] {ef03994d-db44-4cef-acbc-9fcac64d9860} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:23.440287 [ 3731 ] {b196a22a-1abc-4f3d-9769-27c179cd968e} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:33584) (comment: 00036_aggregate_hashed.sql) (in query: CREATE DATABASE IF NOT EXISTS test_f90h9qfq ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:23.441940 [ 3731 ] {b196a22a-1abc-4f3d-9769-27c179cd968e} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:23.828917 [ 2046 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:23.832876 [ 2083 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:23.851697 [ 2087 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:24.022850 [ 1999 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:24.023559 [ 2084 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:24.036006 [ 2103 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:24.138828 [ 3731 ] {da914996-60c6-41f4-b82d-df2b23caa4d0} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47062) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:24.143619 [ 3731 ] {da914996-60c6-41f4-b82d-df2b23caa4d0} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:24.199318 [ 2541 ] {7d55e257-4288-45da-9ea6-3af6c8308eab} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:33598) (comment: 00021_1_select_with_in.sql) (in query: CREATE DATABASE IF NOT EXISTS test_7v8txdg8 ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:24.235800 [ 2541 ] {7d55e257-4288-45da-9ea6-3af6c8308eab} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:24.831562 [ 2006 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:24.834396 [ 2091 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:24.864023 [ 2056 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:25.025073 [ 2089 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:25.025467 [ 2062 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:25.038279 [ 2096 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:25.257904 [ 11399 ] {6cc88568-a721-4233-bf74-1e405bd2bd6a} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47080) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:25.262003 [ 11399 ] {6cc88568-a721-4233-bf74-1e405bd2bd6a} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:25.833575 [ 2041 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:25.838323 [ 2009 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:25.866703 [ 1989 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:26.026683 [ 2019 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:26.026990 [ 2061 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:26.040120 [ 1977 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:26.504659 [ 11877 ] {2963ab96-2189-49cc-a20f-9253db13c3ec} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47100) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:26.505370 [ 3745 ] {cce0825f-8248-4c72-b8ba-8d451fcba65c} executeQuery: Code: 499. DB::Exception: Could not list objects in bucket 'datasets-documentation' with prefix 'MyPrefix/BU - UNIT - 1/', S3 exception: `InvalidAccessKeyId`, message: 'The AWS Access Key Id you provided does not exist in our records.'. (S3_ERROR) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57182) (comment: 02873_s3_presigned_url_and_url_with_special_characters.sql) (in query: select * from s3('https://datasets-documentation.s3.eu-west-3.amazonaws.com/MyPrefix/BU%20-%20UNIT%20-%201/*.parquet');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::S3Exception::S3Exception(Aws::S3::S3Errors, fmt::v8::basic_format_string::type, fmt::v8::type_identity::type, fmt::v8::type_identity::type, fmt::v8::type_identity::type>, String&&, String&&, String&&, String&&) @ 0x000000002daf65f8 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageS3.cpp:238: DB::StorageS3Source::DisclosedGlobIterator::Impl::fillInternalBufferAssumeLocked() @ 0x000000003350e4ae in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageS3.cpp:0: DB::StorageS3Source::DisclosedGlobIterator::Impl::Impl(DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr&, DB::NamesAndTypesList const&, std::shared_ptr, std::vector>*, DB::S3Settings::RequestSettings const&, std::function) @ 0x000000003351e9fc in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageS3Source::DisclosedGlobIterator::Impl* std::construct_at[abi:v15000]&, DB::NamesAndTypesList const&, std::shared_ptr&, std::vector>*&, DB::S3Settings::RequestSettings const&, std::function&, DB::StorageS3Source::DisclosedGlobIterator::Impl*>(DB::StorageS3Source::DisclosedGlobIterator::Impl*, DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr&, DB::NamesAndTypesList const&, std::shared_ptr&, std::vector>*&, DB::S3Settings::RequestSettings const&, std::function&) @ 0x000000003351cea2 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::StorageS3Source::DisclosedGlobIterator::DisclosedGlobIterator(DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr, DB::NamesAndTypesList const&, std::shared_ptr, std::vector>*, DB::S3Settings::RequestSettings const&, std::function) @ 0x00000000334cde85 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageS3Source::DisclosedGlobIterator* std::construct_at[abi:v15000]&, DB::NamesAndTypesList const&, std::shared_ptr&, std::vector>*&, DB::S3Settings::RequestSettings const&, std::function&, DB::StorageS3Source::DisclosedGlobIterator*>(DB::StorageS3Source::DisclosedGlobIterator*, DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr&, DB::NamesAndTypesList const&, std::shared_ptr&, std::vector>*&, DB::S3Settings::RequestSettings const&, std::function&) @ 0x0000000033533dc9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::StorageS3::createFileIterator(DB::StorageS3::Configuration const&, bool, std::shared_ptr, std::shared_ptr, DB::NamesAndTypesList const&, std::vector>*, std::function) @ 0x00000000334e2e00 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/StorageS3.cpp:1555: DB::StorageS3::getTableStructureFromDataImpl(DB::StorageS3::Configuration const&, std::optional const&, std::shared_ptr) @ 0x00000000334e124d in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageS3.cpp:0: DB::StorageS3::StorageS3(DB::StorageS3::Configuration const&, std::shared_ptr, DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, std::optional, bool, std::shared_ptr) @ 0x00000000334e02f0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageS3::Configuration&, std::shared_ptr&, DB::StorageID, DB::ColumnsDescription&, DB::ConstraintsDescription, String, std::nullopt_t const&, void>(std::allocator const&, DB::StorageS3::Configuration&, std::shared_ptr&, DB::StorageID&&, DB::ColumnsDescription&, DB::ConstraintsDescription&&, String&&, std::nullopt_t const&) @ 0x000000002d18e804 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::TableFunctionS3::executeImpl(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool) const @ 0x000000002d17f5e2 in /usr/bin/clickhouse 13. ./build_docker/./src/TableFunctions/ITableFunction.cpp:37: DB::ITableFunction::execute(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool, bool) const @ 0x000000002d8e42eb in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/Context.cpp:1744: DB::Context::executeTableFunction(std::shared_ptr const&, DB::ASTSelectQuery const*) @ 0x000000002f947941 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c27c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:26.507111 [ 11877 ] {2963ab96-2189-49cc-a20f-9253db13c3ec} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:26.514438 [ 3745 ] {cce0825f-8248-4c72-b8ba-8d451fcba65c} TCPHandler: Code: 499. DB::Exception: Could not list objects in bucket 'datasets-documentation' with prefix 'MyPrefix/BU - UNIT - 1/', S3 exception: `InvalidAccessKeyId`, message: 'The AWS Access Key Id you provided does not exist in our records.'. (S3_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::S3Exception::S3Exception(Aws::S3::S3Errors, fmt::v8::basic_format_string::type, fmt::v8::type_identity::type, fmt::v8::type_identity::type, fmt::v8::type_identity::type>, String&&, String&&, String&&, String&&) @ 0x000000002daf65f8 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageS3.cpp:238: DB::StorageS3Source::DisclosedGlobIterator::Impl::fillInternalBufferAssumeLocked() @ 0x000000003350e4ae in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageS3.cpp:0: DB::StorageS3Source::DisclosedGlobIterator::Impl::Impl(DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr&, DB::NamesAndTypesList const&, std::shared_ptr, std::vector>*, DB::S3Settings::RequestSettings const&, std::function) @ 0x000000003351e9fc in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageS3Source::DisclosedGlobIterator::Impl* std::construct_at[abi:v15000]&, DB::NamesAndTypesList const&, std::shared_ptr&, std::vector>*&, DB::S3Settings::RequestSettings const&, std::function&, DB::StorageS3Source::DisclosedGlobIterator::Impl*>(DB::StorageS3Source::DisclosedGlobIterator::Impl*, DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr&, DB::NamesAndTypesList const&, std::shared_ptr&, std::vector>*&, DB::S3Settings::RequestSettings const&, std::function&) @ 0x000000003351cea2 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::StorageS3Source::DisclosedGlobIterator::DisclosedGlobIterator(DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr, DB::NamesAndTypesList const&, std::shared_ptr, std::vector>*, DB::S3Settings::RequestSettings const&, std::function) @ 0x00000000334cde85 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageS3Source::DisclosedGlobIterator* std::construct_at[abi:v15000]&, DB::NamesAndTypesList const&, std::shared_ptr&, std::vector>*&, DB::S3Settings::RequestSettings const&, std::function&, DB::StorageS3Source::DisclosedGlobIterator*>(DB::StorageS3Source::DisclosedGlobIterator*, DB::S3::Client const&, DB::S3::URI const&, std::shared_ptr&, DB::NamesAndTypesList const&, std::shared_ptr&, std::vector>*&, DB::S3Settings::RequestSettings const&, std::function&) @ 0x0000000033533dc9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::StorageS3::createFileIterator(DB::StorageS3::Configuration const&, bool, std::shared_ptr, std::shared_ptr, DB::NamesAndTypesList const&, std::vector>*, std::function) @ 0x00000000334e2e00 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/StorageS3.cpp:1555: DB::StorageS3::getTableStructureFromDataImpl(DB::StorageS3::Configuration const&, std::optional const&, std::shared_ptr) @ 0x00000000334e124d in /usr/bin/clickhouse 10. ./build_docker/./src/Storages/StorageS3.cpp:0: DB::StorageS3::StorageS3(DB::StorageS3::Configuration const&, std::shared_ptr, DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, std::optional, bool, std::shared_ptr) @ 0x00000000334e02f0 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageS3::Configuration&, std::shared_ptr&, DB::StorageID, DB::ColumnsDescription&, DB::ConstraintsDescription, String, std::nullopt_t const&, void>(std::allocator const&, DB::StorageS3::Configuration&, std::shared_ptr&, DB::StorageID&&, DB::ColumnsDescription&, DB::ConstraintsDescription&&, String&&, std::nullopt_t const&) @ 0x000000002d18e804 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::TableFunctionS3::executeImpl(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool) const @ 0x000000002d17f5e2 in /usr/bin/clickhouse 13. ./build_docker/./src/TableFunctions/ITableFunction.cpp:37: DB::ITableFunction::execute(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool, bool) const @ 0x000000002d8e42eb in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/Context.cpp:1744: DB::Context::executeTableFunction(std::shared_ptr const&, DB::ASTSelectQuery const*) @ 0x000000002f947941 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c27c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:26.786733 [ 11397 ] {42938e39-9386-45bd-bb94-5d7981ba2086} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:33632) (comment: 02231_buffer_aggregate_states_leak.sql) (in query: CREATE DATABASE IF NOT EXISTS test_4m7bplza ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:26.788475 [ 11397 ] {42938e39-9386-45bd-bb94-5d7981ba2086} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:26.835799 [ 2076 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:26.840145 [ 2090 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:26.868556 [ 2033 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:27.028396 [ 2107 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:27.029048 [ 2098 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:27.041932 [ 1981 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:27.360859 [ 11349 ] {4b553aa6-4c89-4b33-9d2c-753aeae569f1} DatabaseReplicated (test_11): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:32:27.371158 [ 11349 ] {4b553aa6-4c89-4b33-9d2c-753aeae569f1} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47130) (comment: 02442_auxiliary_zookeeper_endpoint_id.sql) (in query: CREATE TABLE t1_r1 (`x` Int32) ENGINE = ReplicatedMergeTree('/test/02442/{database}/t', 'r1') ORDER BY x SETTINGS index_granularity = 53491, min_bytes_for_wide_part = 465572133, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 11061, prefer_fetch_merged_part_size_threshold = 5563557707, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 1, index_granularity_bytes = 27410971, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 13373, primary_key_compress_block_size = 75918), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:27.378660 [ 11349 ] {4b553aa6-4c89-4b33-9d2c-753aeae569f1} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:27.526009 [ 11396 ] {0f432f13-c62e-4717-b3aa-6cd4b41f76cf} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47156) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:27.529696 [ 11396 ] {0f432f13-c62e-4717-b3aa-6cd4b41f76cf} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:27.798248 [ 12062 ] {0c2ede6f-f2ca-485c-947e-4f88022d91a2} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:33648) (comment: 01088_window_view_default_column.sh) (in query: CREATE DATABASE IF NOT EXISTS test_sejhj9nr ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:27.800238 [ 12062 ] {0c2ede6f-f2ca-485c-947e-4f88022d91a2} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:27.844186 [ 1984 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:27.844616 [ 2015 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:27.870157 [ 2048 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:28.030141 [ 2036 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:28.030687 [ 1978 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:28.043886 [ 2046 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:28.445151 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {51a4a7c5-1863-4af2-93d2-5ec08016b936::202410_1_58_12}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x00000000341744a5 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f15cf48 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:28.588011 [ 12062 ] {a3032855-8d33-45c7-a01b-8f87fd16a005} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47196) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:28.594249 [ 12062 ] {a3032855-8d33-45c7-a01b-8f87fd16a005} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:28.846417 [ 2043 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:28.846693 [ 2030 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:28.961504 [ 2056 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:29.031997 [ 2020 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:29.046787 [ 2032 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:29.134396 [ 2051 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:29.553425 [ 11396 ] {b11b03af-e43b-409d-b255-5c8d17da7790} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:33658) (comment: 00439_fixed_string_filter.sql) (in query: CREATE DATABASE IF NOT EXISTS test_sb2qa52f ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:29.558912 [ 11396 ] {b11b03af-e43b-409d-b255-5c8d17da7790} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:29.609924 [ 3877 ] {3429f0cb-b2ec-46bd-b4d1-ac62a47a9729} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38584) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:29.713547 [ 3877 ] {3429f0cb-b2ec-46bd-b4d1-ac62a47a9729} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:29.948792 [ 2077 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:29.958609 [ 1977 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:29.963143 [ 2094 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:30.033233 [ 2014 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:30.048375 [ 2011 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:30.136362 [ 2081 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:30.717266 [ 3877 ] {08eecd9b-3175-46f3-8f16-4bd72295ed99} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38636) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:30.720520 [ 3877 ] {08eecd9b-3175-46f3-8f16-4bd72295ed99} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:30.725234 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {51a4a7c5-1863-4af2-93d2-5ec08016b936::202410_1_58_12}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::SerializationNullable::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f1eed26 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:30.950677 [ 2007 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:31.060594 [ 2069 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:31.060797 [ 2028 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:31.063055 [ 2055 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:31.063742 [ 11887 ] {1d0b0094-b983-450b-b4a2-9951d838922d} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59140) (comment: 01202_array_auc_special.sql) (in query: CREATE DATABASE IF NOT EXISTS test_imbjnv5x ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:31.064069 [ 1982 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:31.065961 [ 11887 ] {1d0b0094-b983-450b-b4a2-9951d838922d} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:31.139943 [ 1984 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:31.614323 [ 2694 ] {02d3497a-3c68-43a8-b808-82c439ffc330} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38670) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:31.628153 [ 2694 ] {02d3497a-3c68-43a8-b808-82c439ffc330} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:31.889654 [ 11837 ] {9b1b7e4e-8a61-4cea-bcd9-d2a319f262f0} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59176) (comment: 02136_scalar_read_rows_json.sh) (in query: CREATE DATABASE IF NOT EXISTS test_rm8d5p5v ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:31.904503 [ 11837 ] {9b1b7e4e-8a61-4cea-bcd9-d2a319f262f0} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:31.955639 [ 2027 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:32.062554 [ 2079 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:32.062877 [ 2089 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:32.064322 [ 2062 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:32.065774 [ 2096 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:32.141831 [ 2049 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:32.583608 [ 2694 ] {074a69ea-1d06-4638-80bd-181c96f9d168} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38700) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:32.598122 [ 2694 ] {074a69ea-1d06-4638-80bd-181c96f9d168} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:32.958278 [ 2039 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:33.064425 [ 2097 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:33.065350 [ 2086 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:33.066020 [ 1976 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:33.077789 [ 2014 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:33.099307 [ 11837 ] {fa696791-f801-4d4c-b71a-6bd00a6fa0ce} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59178) (comment: 02165_insert_from_infile.sql) (in query: CREATE DATABASE IF NOT EXISTS test_3tvk34ux ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:33.112576 [ 11837 ] {fa696791-f801-4d4c-b71a-6bd00a6fa0ce} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:33.277253 [ 2102 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:33.285281 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {51a4a7c5-1863-4af2-93d2-5ec08016b936::202410_1_58_12}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x00000000341744a5 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./src/DataTypes/Serializations/SerializationNullable.cpp:0: DB::SerializationNullable::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f1efa5c in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:33.435266 [ 11880 ] {70fc4d12-e80c-4b48-8500-e5ee02cfb1fd} executeQuery: Code: 210. DB::Exception: Unable to connect to HDFS: Hdfs::HdfsRpcException: HdfsFailoverException: Failed to invoke RPC call "getFsStats" on server "localhost:12222" Caused by: HdfsNetworkConnectException: Connect to "localhost:12222" failed: (errno: 111) Connection refused. (NETWORK_ERROR) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56488) (comment: 02725_database_hdfs.sh) (in query: SELECT * FROM "hdfs://localhost:12222/test_02725_1.tsv" ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/HDFS/HDFSCommon.cpp:176: DB::createHDFSFS(hdfsBuilder*) @ 0x000000002ddbade6 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/HDFS/StorageHDFS.cpp:0: DB::(anonymous namespace)::getPathsList(String const&, String const&, std::shared_ptr) @ 0x000000002dd7c452 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::StorageHDFS::getTableStructureFromData(String const&, String const&, String const&, std::shared_ptr) @ 0x000000002dd7a07f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/HDFS/StorageHDFS.cpp:0: DB::StorageHDFS::StorageHDFS(String const&, DB::StorageID const&, String const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, std::shared_ptr, String const&, bool, std::shared_ptr) @ 0x000000002dd78dd2 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String const&, DB::StorageID, String const&, DB::ColumnsDescription const&, DB::ConstraintsDescription, String, std::shared_ptr&, String const&, void>(std::allocator const&, String const&, DB::StorageID&&, String const&, DB::ColumnsDescription const&, DB::ConstraintsDescription&&, String&&, std::shared_ptr&, String const&) @ 0x000000002d1bc5b8 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::TableFunctionHDFS::getStorage(String const&, String const&, DB::ColumnsDescription const&, std::shared_ptr, String const&, String const&) const @ 0x000000002d1ba0e4 in /usr/bin/clickhouse 9. ./build_docker/./src/TableFunctions/ITableFunctionFileLike.cpp:121: DB::ITableFunctionFileLike::executeImpl(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool) const @ 0x000000002d14318b in /usr/bin/clickhouse 10. ./build_docker/./src/TableFunctions/ITableFunction.cpp:37: DB::ITableFunction::execute(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool, bool) const @ 0x000000002d8e42eb in /usr/bin/clickhouse 11. ./build_docker/./src/Databases/DatabaseHDFS.cpp:129: DB::DatabaseHDFS::getTableImpl(String const&, std::shared_ptr) const @ 0x0000000031151b94 in /usr/bin/clickhouse 12. ./build_docker/./src/Databases/DatabaseHDFS.cpp:0: DB::DatabaseHDFS::getTable(String const&, std::shared_ptr) const @ 0x000000003115269c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:33.465795 [ 11880 ] {70fc4d12-e80c-4b48-8500-e5ee02cfb1fd} TCPHandler: Code: 210. DB::Exception: Unable to connect to HDFS: Hdfs::HdfsRpcException: HdfsFailoverException: Failed to invoke RPC call "getFsStats" on server "localhost:12222" Caused by: HdfsNetworkConnectException: Connect to "localhost:12222" failed: (errno: 111) Connection refused. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/HDFS/HDFSCommon.cpp:176: DB::createHDFSFS(hdfsBuilder*) @ 0x000000002ddbade6 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/HDFS/StorageHDFS.cpp:0: DB::(anonymous namespace)::getPathsList(String const&, String const&, std::shared_ptr) @ 0x000000002dd7c452 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::StorageHDFS::getTableStructureFromData(String const&, String const&, String const&, std::shared_ptr) @ 0x000000002dd7a07f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/HDFS/StorageHDFS.cpp:0: DB::StorageHDFS::StorageHDFS(String const&, DB::StorageID const&, String const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, std::shared_ptr, String const&, bool, std::shared_ptr) @ 0x000000002dd78dd2 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String const&, DB::StorageID, String const&, DB::ColumnsDescription const&, DB::ConstraintsDescription, String, std::shared_ptr&, String const&, void>(std::allocator const&, String const&, DB::StorageID&&, String const&, DB::ColumnsDescription const&, DB::ConstraintsDescription&&, String&&, std::shared_ptr&, String const&) @ 0x000000002d1bc5b8 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::TableFunctionHDFS::getStorage(String const&, String const&, DB::ColumnsDescription const&, std::shared_ptr, String const&, String const&) const @ 0x000000002d1ba0e4 in /usr/bin/clickhouse 9. ./build_docker/./src/TableFunctions/ITableFunctionFileLike.cpp:121: DB::ITableFunctionFileLike::executeImpl(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool) const @ 0x000000002d14318b in /usr/bin/clickhouse 10. ./build_docker/./src/TableFunctions/ITableFunction.cpp:37: DB::ITableFunction::execute(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool, bool) const @ 0x000000002d8e42eb in /usr/bin/clickhouse 11. ./build_docker/./src/Databases/DatabaseHDFS.cpp:129: DB::DatabaseHDFS::getTableImpl(String const&, std::shared_ptr) const @ 0x0000000031151b94 in /usr/bin/clickhouse 12. ./build_docker/./src/Databases/DatabaseHDFS.cpp:0: DB::DatabaseHDFS::getTable(String const&, std::shared_ptr) const @ 0x000000003115269c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:33.603778 [ 12022 ] {753156d3-197b-4a67-9f87-69286a418587} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38782) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:33.604173 [ 2694 ] {dd6ff23c-65ba-45ca-ab1c-966860d97639} executeQuery: Code: 57. DB::Exception: Cannot attach table with UUID 8334c7b5-4a4a-49ff-8862-3732b5815221, because it was detached but still used by some query. Retry later. (TABLE_ALREADY_EXISTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38770) (comment: 01107_atomic_db_detach_attach.sh) (in query: ATTACH TABLE test_01107.mt), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, DB::UUIDTag> const&>(int, FormatStringHelperImpl, DB::UUIDTag> const&>::type>, StrongTypedef, DB::UUIDTag> const&) @ 0x000000002f33003b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseAtomic.cpp:368: DB::DatabaseAtomic::assertDetachedTableNotInUse(StrongTypedef, DB::UUIDTag> const&) @ 0x000000002f31bd59 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseAtomic.cpp:0: DB::DatabaseAtomic::checkDetachedTableNotInUse(StrongTypedef, DB::UUIDTag> const&) @ 0x000000002f32f772 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f6593e in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:33.609576 [ 12022 ] {753156d3-197b-4a67-9f87-69286a418587} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:33.627267 [ 2694 ] {dd6ff23c-65ba-45ca-ab1c-966860d97639} TCPHandler: Code: 57. DB::Exception: Cannot attach table with UUID 8334c7b5-4a4a-49ff-8862-3732b5815221, because it was detached but still used by some query. Retry later. (TABLE_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception, DB::UUIDTag> const&>(int, FormatStringHelperImpl, DB::UUIDTag> const&>::type>, StrongTypedef, DB::UUIDTag> const&) @ 0x000000002f33003b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseAtomic.cpp:368: DB::DatabaseAtomic::assertDetachedTableNotInUse(StrongTypedef, DB::UUIDTag> const&) @ 0x000000002f31bd59 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseAtomic.cpp:0: DB::DatabaseAtomic::checkDetachedTableNotInUse(StrongTypedef, DB::UUIDTag> const&) @ 0x000000002f32f772 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f6593e in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:33.961016 [ 2034 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:34.080947 [ 2054 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:34.080980 [ 2036 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:34.081152 [ 2053 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:34.081208 [ 2031 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:34.082222 [ 12137 ] {d659ef9d-fc82-4481-af58-cb31a4cdb705} executeQuery: Code: 219. DB::Exception: Database test_01107 cannot be detached, because some tables are still in use. Retry later. (DATABASE_NOT_EMPTY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38828) (comment: 01107_atomic_db_detach_attach.sh) (in query: DETACH DATABASE test_01107), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseAtomic.cpp:408: DB::DatabaseAtomic::assertCanBeDetached(bool) @ 0x000000002f327747 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:336: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr&, std::vector, DB::UUIDTag>, std::allocator, DB::UUIDTag>>>&) @ 0x0000000031173bed in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x000000003116ac2b in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168341 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:34.088401 [ 12137 ] {d659ef9d-fc82-4481-af58-cb31a4cdb705} TCPHandler: Code: 219. DB::Exception: Database test_01107 cannot be detached, because some tables are still in use. Retry later. (DATABASE_NOT_EMPTY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseAtomic.cpp:408: DB::DatabaseAtomic::assertCanBeDetached(bool) @ 0x000000002f327747 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:336: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr&, std::vector, DB::UUIDTag>, std::allocator, DB::UUIDTag>>>&) @ 0x0000000031173bed in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x000000003116ac2b in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168341 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:34.207068 [ 11837 ] {a8ca2a8f-af2d-4b0a-a5cf-cfda5451bdc3} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59186) (comment: 00377_shard_group_uniq_array_of_string_array.sql) (in query: CREATE DATABASE IF NOT EXISTS test_2oow213d ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:34.221463 [ 11837 ] {a8ca2a8f-af2d-4b0a-a5cf-cfda5451bdc3} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:34.260831 [ 11408 ] {3cd6da28-5270-4273-913d-afdacd58be80} test_wzyo4kg2.test (5e460691-6e4c-4b69-b44e-38cb7a0beb39): Cannot find transaction (57, 156, 2d3ab1e7-d985-412c-831c-f6fc9e49c8b2) which had started mutation mutation_1.txt, probably it finished 2024.10.22 00:32:34.280620 [ 2084 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:34.560080 [ 12137 ] {2d47f8cb-d3a0-4e23-9b5c-48e7c2c54c7a} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38854) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:34.593317 [ 12137 ] {2d47f8cb-d3a0-4e23-9b5c-48e7c2c54c7a} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:35.010399 [ 2074 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:35.017406 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {51a4a7c5-1863-4af2-93d2-5ec08016b936::202410_1_58_12}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1114301 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/SerializationNullable.cpp:0: DB::SerializationNullable::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f1efa5c in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:35.082928 [ 2035 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:35.083568 [ 2041 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:35.084002 [ 2012 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:35.085176 [ 1996 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:35.258713 [ 3737 ] {084ca6d0-51a0-4164-9065-64052ecc48be} test_wzyo4kg2.test (5e460691-6e4c-4b69-b44e-38cb7a0beb39): Cannot find transaction (58, 36, 2d3ab1e7-d985-412c-831c-f6fc9e49c8b2) which had started mutation mutation_3.txt, probably it finished 2024.10.22 00:32:35.261945 [ 3737 ] {084ca6d0-51a0-4164-9065-64052ecc48be} test_wzyo4kg2.test (5e460691-6e4c-4b69-b44e-38cb7a0beb39): Cannot find transaction (57, 156, 2d3ab1e7-d985-412c-831c-f6fc9e49c8b2) which had started mutation mutation_1.txt, probably it finished 2024.10.22 00:32:35.289065 [ 2088 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:35.450415 [ 11356 ] {4654d145-a82a-459e-acbe-970cf5a0e2c5} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59192) (comment: 02737_session_timezone.sql) (in query: CREATE DATABASE IF NOT EXISTS test_d97bwhu7 ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:35.468615 [ 11356 ] {4654d145-a82a-459e-acbe-970cf5a0e2c5} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:35.646979 [ 2844 ] {4df43242-24df-47ab-8e06-6ae09e9c601a} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38956) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:35.655203 [ 2844 ] {4df43242-24df-47ab-8e06-6ae09e9c601a} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:36.021713 [ 2101 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:36.059389 [ 3737 ] {084ca6d0-51a0-4164-9065-64052ecc48be} executeQuery: Code: 341. DB::Exception: Exception happened during execution of mutation 'mutation_4.txt' with part 'all_2_2_0' reason: 'Serialization error: part all_2_2_0 is locked by transaction 3880372707437889506'. This error maybe retryable or not. In case of unretryable error, mutation can be killed with KILL MUTATION query. (UNFINISHED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38932) (comment: 01002_alter_nullable_adaptive_granularity_long.sh) (in query: ALTER TABLE test MODIFY COLUMN x Nullable(UInt8);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, String&&, String&, String&) @ 0x00000000343bf960 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeMutationStatus.cpp:26: DB::checkMutationStatus(std::optional&, std::set, std::allocator> const&) @ 0x00000000343bf397 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageMergeTree.cpp:0: DB::StorageMergeTree::waitForMutation(long, String const&, bool) @ 0x000000003490eaa1 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::StorageMergeTree::alter(DB::AlterCommands const&, std::shared_ptr, std::unique_lock&) @ 0x0000000034906938 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112cb7d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:36.075647 [ 3737 ] {084ca6d0-51a0-4164-9065-64052ecc48be} TCPHandler: Code: 341. DB::Exception: Exception happened during execution of mutation 'mutation_4.txt' with part 'all_2_2_0' reason: 'Serialization error: part all_2_2_0 is locked by transaction 3880372707437889506'. This error maybe retryable or not. In case of unretryable error, mutation can be killed with KILL MUTATION query. (UNFINISHED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, String&&, String&, String&) @ 0x00000000343bf960 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeMutationStatus.cpp:26: DB::checkMutationStatus(std::optional&, std::set, std::allocator> const&) @ 0x00000000343bf397 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageMergeTree.cpp:0: DB::StorageMergeTree::waitForMutation(long, String const&, bool) @ 0x000000003490eaa1 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::StorageMergeTree::alter(DB::AlterCommands const&, std::shared_ptr, std::unique_lock&) @ 0x0000000034906938 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112cb7d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:36.088935 [ 2065 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:36.090976 [ 2044 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:36.092538 [ 2076 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:36.188954 [ 2007 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:36.294112 [ 2028 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:36.678838 [ 11870 ] {0ccc8802-d75d-4b88-9462-5776cd96ba4f} test_wzyo4kg2.test (5e460691-6e4c-4b69-b44e-38cb7a0beb39): Cannot find transaction (58, 36, 2d3ab1e7-d985-412c-831c-f6fc9e49c8b2) which had started mutation mutation_3.txt, probably it finished 2024.10.22 00:32:36.684264 [ 11870 ] {0ccc8802-d75d-4b88-9462-5776cd96ba4f} test_wzyo4kg2.test (5e460691-6e4c-4b69-b44e-38cb7a0beb39): Cannot find transaction (57, 156, 2d3ab1e7-d985-412c-831c-f6fc9e49c8b2) which had started mutation mutation_1.txt, probably it finished 2024.10.22 00:32:36.794528 [ 2844 ] {12e95438-4f43-4dff-a9d1-95ee75fd5643} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:39004) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:36.813214 [ 2844 ] {12e95438-4f43-4dff-a9d1-95ee75fd5643} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:37.041805 [ 2070 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:37.042045 [ 11356 ] {56f3e689-371f-4f06-bdb7-83a5d1bbbcec} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59198) (comment: 02543_alter_rename_modify_stuck.sh) (in query: CREATE DATABASE IF NOT EXISTS test_i6zp66uk ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:37.044202 [ 11356 ] {56f3e689-371f-4f06-bdb7-83a5d1bbbcec} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:37.073130 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {51a4a7c5-1863-4af2-93d2-5ec08016b936::202410_1_59_12}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x00000000341744a5 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:37.091031 [ 1979 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:37.098337 [ 2043 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:37.098788 [ 2066 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:37.192624 [ 2051 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:37.297108 [ 2079 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:37.743965 [ 11356 ] {832e5d87-f74b-4b3e-9866-ea59c11f2a59} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:39048) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:37.779356 [ 11356 ] {832e5d87-f74b-4b3e-9866-ea59c11f2a59} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:38.054284 [ 2095 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:38.092796 [ 2035 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:38.099995 [ 2019 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:38.101091 [ 2061 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:38.121987 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {51a4a7c5-1863-4af2-93d2-5ec08016b936::202410_1_59_12}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x00000000341744a5 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:38.204597 [ 2077 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:38.299650 [ 1990 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:38.761510 [ 11874 ] {281dfedc-4d61-4946-a9ad-13f18b5e20ba} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:39108) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:38.769176 [ 11874 ] {281dfedc-4d61-4946-a9ad-13f18b5e20ba} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:38.776140 [ 2844 ] {ac7d85e6-c5b4-4921-9433-27e98ae39408} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59206) (comment: 02896_multiple_OR.sql) (in query: CREATE DATABASE IF NOT EXISTS test_kt4d23tk ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:38.781455 [ 2844 ] {ac7d85e6-c5b4-4921-9433-27e98ae39408} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:38.831553 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {51a4a7c5-1863-4af2-93d2-5ec08016b936::202410_1_59_12}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x00000000341744a5 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:39.055844 [ 1994 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:39.094380 [ 2055 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:39.102534 [ 2015 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:39.204396 [ 2034 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:39.210681 [ 2036 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:39.301574 [ 2054 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:39.576526 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {51a4a7c5-1863-4af2-93d2-5ec08016b936::202410_1_59_12}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x00000000341744a5 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:39.765971 [ 11874 ] {d7e40558-2531-4483-be08-83b4b124efd4} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40028) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:39.785525 [ 11874 ] {d7e40558-2531-4483-be08-83b4b124efd4} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:40.059430 [ 2056 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:40.096213 [ 1993 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:40.106142 [ 2074 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:40.160969 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {51a4a7c5-1863-4af2-93d2-5ec08016b936::202410_1_59_12}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x00000000341744a5 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:40.206631 [ 2085 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:40.212878 [ 2104 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:40.313315 [ 2022 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:40.606671 [ 11408 ] {68d18ed0-f36f-458e-b903-afef33fb96fc} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59212) (comment: 02835_nested_array_lowcardinality.sql) (in query: CREATE DATABASE IF NOT EXISTS test_fj6i7eq5 ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:40.633204 [ 11408 ] {68d18ed0-f36f-458e-b903-afef33fb96fc} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:40.710710 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 34213887 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory>::resize(unsigned long) @ 0x000000001d74f0a4 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000002e5d2ecd in /usr/bin/clickhouse 11. ./build_docker/./src/IO/BufferBase.h:40: DB::WriteBufferFromS3::nextImpl() @ 0x000000002e5d1e88 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x000000002ddd754b in /usr/bin/clickhouse 13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x000000002dddb48b in /usr/bin/clickhouse 14. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x0000000033cb7df4 in /usr/bin/clickhouse 15. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000bdd68e8 in /usr/bin/clickhouse 16. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:0: DB::CompressedWriteBuffer::nextImpl() @ 0x000000002ec7b6ad in /usr/bin/clickhouse 17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x0000000033cb7df4 in /usr/bin/clickhouse 18. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker::__call_impl, std::allocator>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419e42b in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set, std::allocator>&) @ 0x0000000034193fd8 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_map:1805: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set, std::allocator>&, std::vector> const&) @ 0x00000000341918dd in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x000000003418debf in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergedColumnOnlyOutputStream.cpp:56: DB::MergedColumnOnlyOutputStream::write(DB::Block const&) @ 0x00000000345d5420 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::VerticalMergeStage::executeVerticalMergeForOneColumn() const @ 0x0000000033ea435c in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:842: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba8f4 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::VerticalMergeStage::execute() @ 0x0000000033eabd39 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:41.016630 [ 11874 ] {5953bb02-9823-4b1b-a9b6-e88b75eb60d2} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40056) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:41.027682 [ 11874 ] {5953bb02-9823-4b1b-a9b6-e88b75eb60d2} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:41.072107 [ 2014 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:41.097796 [ 2057 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:41.107860 [ 2045 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:41.305121 [ 2047 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:41.305394 [ 2101 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:41.314847 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {51a4a7c5-1863-4af2-93d2-5ec08016b936::202410_1_59_12}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1114301 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/SerializationNullable.cpp:0: DB::SerializationNullable::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f1efa5c in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:41.324697 [ 2011 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:42.010944 [ 11408 ] {6e2cfad2-33e5-44a9-9fbd-1ee8ba947785} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40122) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:42.019025 [ 11408 ] {6e2cfad2-33e5-44a9-9fbd-1ee8ba947785} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:42.073699 [ 2002 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:42.099306 [ 2069 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:42.109519 [ 2021 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:42.323013 [ 11419 ] {5aac001b-4582-49d4-81de-62f835e7497a} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47440) (comment: 01457_int256_hashing.sql) (in query: CREATE DATABASE IF NOT EXISTS test_8huu74wc ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:42.322943 [ 2080 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:42.323489 [ 2051 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:42.323886 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 4194556 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x00000000345c9a3a in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c4485 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ac548 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c53899 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c51386 in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d961c79 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:42.326422 [ 2026 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:42.341620 [ 11419 ] {5aac001b-4582-49d4-81de-62f835e7497a} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:42.667390 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {51a4a7c5-1863-4af2-93d2-5ec08016b936::202410_1_59_12}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./src/DataTypes/Serializations/SerializationSparse.cpp:0: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f271e82 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:43.002843 [ 11846 ] {a08b1f0e-2b55-4aca-a9f3-a78e96152118} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40188) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:43.023152 [ 11846 ] {a08b1f0e-2b55-4aca-a9f3-a78e96152118} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:43.076777 [ 2061 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:43.100870 [ 2018 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:43.112100 [ 1980 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:43.371291 [ 1977 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:43.371400 [ 11864 ] {cef2c8ba-b0dc-4c5f-9802-9d11cee227e7} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:40124). (NETWORK_ERROR) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40124) (comment: 01002_alter_nullable_adaptive_granularity_long.sh) (in query: INSERT INTO test SELECT rand() FROM numbers(1000)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProfileEvents() @ 0x0000000034efcbab in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed72a1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 11. ? @ 0x00007f11b339dac3 in ? 12. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:43.371492 [ 2088 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:43.371092 [ 2027 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:43.374647 [ 11864 ] {cef2c8ba-b0dc-4c5f-9802-9d11cee227e7} TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:40124). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x0000000034f12fcc in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__hash_table:1473: DB::TCPHandler::sendLogs() @ 0x0000000034ef1d88 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed8b98 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:43.376254 [ 11864 ] {cef2c8ba-b0dc-4c5f-9802-9d11cee227e7} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:40124). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendProfileEvents() @ 0x0000000034efcbab in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed72a1 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 11. ? @ 0x00007f11b339dac3 in ? 12. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:43.384494 [ 11864 ] {cef2c8ba-b0dc-4c5f-9802-9d11cee227e7} TCPHandler: Client has gone away. 2024.10.22 00:32:43.496046 [ 11870 ] {0ccc8802-d75d-4b88-9462-5776cd96ba4f} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:39000). (NETWORK_ERROR) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:39000) (comment: 01002_alter_nullable_adaptive_granularity_long.sh) (in query: ALTER TABLE test MODIFY COLUMN x UInt8;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x0000000034ef2754 in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed731c in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 11. ? @ 0x00007f11b339dac3 in ? 12. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:43.502400 [ 11870 ] {0ccc8802-d75d-4b88-9462-5776cd96ba4f} TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:39000). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x0000000034f12fcc in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__hash_table:1473: DB::TCPHandler::sendLogs() @ 0x0000000034ef1d88 in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed8b98 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:43.505220 [ 11870 ] {0ccc8802-d75d-4b88-9462-5776cd96ba4f} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:39000). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::TCPHandler::sendEndOfStream() @ 0x0000000034ef2754 in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed731c in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 11. ? @ 0x00007f11b339dac3 in ? 12. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:43.506529 [ 11870 ] {0ccc8802-d75d-4b88-9462-5776cd96ba4f} TCPHandler: Client has gone away. 2024.10.22 00:32:43.859224 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {51a4a7c5-1863-4af2-93d2-5ec08016b936::202410_1_59_12}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f2711e3 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:43.913314 [ 11406 ] {1d5d1400-3e4a-48ae-93a5-426fe04317a7} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40230) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:43.938625 [ 11406 ] {1d5d1400-3e4a-48ae-93a5-426fe04317a7} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:44.079985 [ 2094 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:44.113077 [ 1992 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:44.113666 [ 2010 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:44.219885 [ 11867 ] {205f8dfc-9e07-489d-97eb-41e68d354b6a} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47454) (comment: 02366_explain_query_tree.sql) (in query: CREATE DATABASE IF NOT EXISTS test_jf7h00kc ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:44.222626 [ 11867 ] {205f8dfc-9e07-489d-97eb-41e68d354b6a} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:44.375774 [ 2031 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:44.377719 [ 2107 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:44.377953 [ 2054 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:44.871243 [ 3746 ] {c18fc92d-7371-4837-9875-c8fa362dfa7b} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47470) (comment: 00825_protobuf_format_array_of_arrays.sh) (in query: CREATE DATABASE IF NOT EXISTS test_qritap3u ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:44.873232 [ 3746 ] {c18fc92d-7371-4837-9875-c8fa362dfa7b} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:44.984509 [ 11326 ] {ca3c12c4-e87d-4ff6-a30a-e03df027f7ea} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40260) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:44.988611 [ 11326 ] {ca3c12c4-e87d-4ff6-a30a-e03df027f7ea} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:45.081806 [ 1997 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:45.114700 [ 2008 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:45.115236 [ 2025 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:45.380695 [ 2096 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:45.381374 [ 1999 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:45.382639 [ 2056 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:45.544280 [ 3746 ] {579cd427-8725-48a8-9b92-b0844a9bdb3a} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47480) (comment: 02714_read_bytes_aggregateFunction.sql) (in query: CREATE DATABASE IF NOT EXISTS test_dksvyuy4 ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:45.546039 [ 3746 ] {579cd427-8725-48a8-9b92-b0844a9bdb3a} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:45.897505 [ 11419 ] {3b92352f-b1dc-41a4-8e5a-9382e6e6da4a} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40286) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:45.909289 [ 11419 ] {3b92352f-b1dc-41a4-8e5a-9382e6e6da4a} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:46.079616 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.60 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:46.084790 [ 2059 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:46.116950 [ 2019 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:46.117342 [ 2061 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:46.151008 [ 11406 ] {eafd5d13-93d8-49ac-aa10-d9165c70d5ee} executeQuery: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47494) (comment: 02478_factorial.sql) (in query: CREATE DATABASE IF NOT EXISTS test_li0fpko0 ENGINE=Replicated('/test/db/test_2', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:46.152754 [ 11406 ] {eafd5d13-93d8-49ac-aa10-d9165c70d5ee} DynamicQueryHandler: Code: 999. Coordination::Exception: Transaction failed: Op #0, path: /test/db/test_2/replicas/s1|r1. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&) @ 0x000000000ce14f27 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: zkutil::KeeperMultiException::KeeperMultiException(Coordination::Error, unsigned long, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x000000003638f079 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1291: zkutil::KeeperMultiException::check(Coordination::Error, std::vector, std::allocator>> const&, std::vector, std::allocator>> const&) @ 0x0000000036372688 in /usr/bin/clickhouse 5. ./build_docker/./src/Databases/DatabaseReplicated.cpp:487: DB::DatabaseReplicated::createReplicaNodesInZooKeeper(std::shared_ptr const&) @ 0x000000002f3830df in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:355: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000002f37939f in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000002f387fc1 in /usr/bin/clickhouse 8. ./build_docker/./src/Databases/TablesLoader.cpp:0: DB::TablesLoader::loadTables() @ 0x000000003115768b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:329: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x0000000030f29415 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750a2 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/HTTPHandler.cpp:864: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x0000000034dcccae in /usr/bin/clickhouse 14. ./build_docker/./src/Server/HTTPHandler.cpp:1059: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034dd91b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:46.156966 [ 11406 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.60 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:46.270007 [ 11419 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.60 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:46.509549 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.61 GiB (attempt to allocate chunk of 5164865 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:46.509826 [ 2077 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:46.509955 [ 2078 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:46.510062 [ 1977 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:46.572582 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.60 GiB (attempt to allocate chunk of 3170304 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory>::resize(unsigned long) @ 0x000000001d74f0a4 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000002e5d2ecd in /usr/bin/clickhouse 11. ./build_docker/./src/IO/BufferBase.h:40: DB::WriteBufferFromS3::nextImpl() @ 0x000000002e5d1e88 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x000000002ddd754b in /usr/bin/clickhouse 13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x000000002dddb48b in /usr/bin/clickhouse 14. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x0000000033cb7df4 in /usr/bin/clickhouse 15. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000bdd68e8 in /usr/bin/clickhouse 16. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:0: DB::CompressedWriteBuffer::nextImpl() @ 0x000000002ec7b6ad in /usr/bin/clickhouse 17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x0000000033cb7df4 in /usr/bin/clickhouse 18. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker::__call_impl, std::allocator>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419e42b in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set, std::allocator>&) @ 0x0000000034193fd8 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_map:1805: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set, std::allocator>&, std::vector> const&) @ 0x00000000341918dd in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x000000003418debf in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x00000000345c1f17 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f272 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:46.829077 [ 11419 ] {4bc9e2f4-6e1b-4e1b-8269-378cbd107919} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40304) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:46.834498 [ 11419 ] {4bc9e2f4-6e1b-4e1b-8269-378cbd107919} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:46.840446 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:47.086862 [ 2072 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:47.118840 [ 2060 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:47.119434 [ 2065 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:47.286477 [ 11419 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:47.287535 [ 2194 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1052630 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x00000000345c7541 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c4485 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:89: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c29f4 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x0000000033eab9b7 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033ebae9c in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x0000000033eabdb9 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:47.295402 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1052630 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x00000000345c7541 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c4485 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:89: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c29f4 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x0000000033eab9b7 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033ebae9c in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x0000000033eabdb9 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:47.512478 [ 2098 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:47.513203 [ 1994 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:47.596197 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:47.646355 [ 2055 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:47.652525 [ 2197 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:47.654280 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:47.679466 [ 11419 ] {103f3a4e-269b-4a42-8ad6-1f9c910ed0bc} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40314) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:47.681975 [ 11419 ] {103f3a4e-269b-4a42-8ad6-1f9c910ed0bc} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:47.842142 [ 2191 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp2d66dc0d-69f4-4df8-95df-1c575d68867b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:47.945742 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:48.088540 [ 2101 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:48.121844 [ 2107 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:48.122235 [ 2031 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:48.142125 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:48.382267 [ 2194 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpdf9b7435-e939-489a-825a-c2c48a5f3c78' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:48.386492 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:48.784555 [ 2247 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 5009369 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x00000000345c85c1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c4485 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ac548 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cb02d9 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031caddc6 in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d967679 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:48.785016 [ 2051 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:48.784907 [ 11419 ] {b692d204-5424-4d2d-a30a-e9dbf3b3ee2c} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:40318) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:48.785375 [ 2026 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:48.785532 [ 1997 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:48.789061 [ 2195 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:48.789920 [ 11419 ] {b692d204-5424-4d2d-a30a-e9dbf3b3ee2c} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:48.790548 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:48.994428 [ 2191 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:48.996272 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:49.065773 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 5143841 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:49.090149 [ 2049 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:49.123960 [ 1998 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:49.124647 [ 2042 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:49.276843 [ 11839 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:49.365308 [ 2194 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:49.366318 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:49.385129 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:49.530422 [ 2192 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp1c2e816b-b8ac-4b67-8bf4-0e76bcf86450' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:49.536277 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:49.653394 [ 11839 ] {a9223a8f-c49d-4b10-9bee-f2d8eb581bf3} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:55848) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:49.661484 [ 11839 ] {a9223a8f-c49d-4b10-9bee-f2d8eb581bf3} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:49.739554 [ 2191 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:49.741035 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:49.786783 [ 2029 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:49.797853 [ 2091 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:49.888308 [ 2100 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:49.928143 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:50.134059 [ 1990 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:50.134080 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 5121737 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c53899 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:50.134239 [ 2097 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:50.134429 [ 2086 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:50.187186 [ 2186 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:50.190016 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:50.296782 [ 12113 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:50.400497 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:50.434474 [ 2188 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpa8f4e55a-ac21-4fc9-b05a-c64fdb88db25' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:50.542078 [ 12113 ] {7f83d15a-7491-4302-a610-403954e252b7} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:55864) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:50.544193 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:50.548842 [ 12113 ] {7f83d15a-7491-4302-a610-403954e252b7} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:50.792132 [ 2075 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:50.799749 [ 1983 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:50.818205 [ 2187 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:50.820007 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:50.890135 [ 2098 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:51.135888 [ 2053 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:51.136096 [ 2037 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:51.136529 [ 2039 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:51.299203 [ 12113 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:51.363507 [ 2194 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpfaf983e5-73d7-47ea-99a2-3afe28d4f9d1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:51.366570 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:51.437477 [ 2192 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:51.438762 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:51.531937 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:51.567613 [ 12113 ] {e0735f97-2e14-44cb-be71-6ba63020a4b4} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:55890) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:51.581050 [ 12113 ] {e0735f97-2e14-44cb-be71-6ba63020a4b4} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:51.692525 [ 2186 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:51.693844 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:51.793863 [ 2043 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:51.801797 [ 2032 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:51.898907 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 5121857 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:51.898999 [ 1995 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:52.062695 [ 2196 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpeee439bc-bcef-44bc-b84e-9a09af4dd1dd' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:52.065398 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:52.137786 [ 2062 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:52.138176 [ 1979 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:52.138871 [ 1984 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:52.281971 [ 12113 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:52.342865 [ 12113 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:52.406132 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:52.437124 [ 12113 ] {fc95464f-ace2-4657-97fa-6cff36022ba7} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:55902) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:52.445149 [ 12113 ] {fc95464f-ace2-4657-97fa-6cff36022ba7} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:52.517156 [ 2190 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:52.523451 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:52.896695 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.55 GiB (attempt to allocate chunk of 4196597 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000000c2f32f0 in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/smart_ptr/detail/atomic_count_gcc_atomic.hpp:38: DB::ColumnVector::permute(DB::PODArray, 63ul, 64ul> const&, unsigned long) const @ 0x000000003289f1ab in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::permuteBlockIfNeeded(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x000000003416c5ff in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x000000003415b716 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x00000000345c211c in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345abb85 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 24. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:52.896781 [ 2012 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:52.896993 [ 2083 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:52.959533 [ 2196 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:52.959665 [ 2020 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:52.960897 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:52.963446 [ 3736 ] {da200cdd-f87f-4680-acad-ef15dc6ba77b} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/egm/debmdbpopvgzerdzknacluzkwcyha, hash key: 9c0cea0706f1246c21e64134b28797ea, file_offset_of_buffer_end: 0, read_until_position: 50628, internal buffer end: 50628, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: da200cdd-f87f-4680-acad-ef15dc6ba77b:18522, file segment info: File segment: [0, 50627], key: 9c0cea0706f1246c21e64134b28797ea, state: DOWNLOADING, downloaded size: 0, reserved size: 50628, downloader id: da200cdd-f87f-4680-acad-ef15dc6ba77b:18522, current write offset: 0, caller id: da200cdd-f87f-4680-acad-ef15dc6ba77b:18522, kind: Regular, unbound: 0: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_19_19_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:49568) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format JSONCompactEachRow ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/tuple:533: DB::AsynchronousBoundedReadBuffer::nextImpl() @ 0x000000002dd1f0ef in /usr/bin/clickhouse 20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 21. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec784a9 in /usr/bin/clickhouse 22. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray, 63ul, 64ul>&, DB::PODArray, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x000000002f282da8 in /usr/bin/clickhouse 23. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27dda3 in /usr/bin/clickhouse 24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 2024.10.22 00:32:53.139699 [ 2061 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:53.140313 [ 1980 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:53.141454 [ 2029 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:53.142818 [ 2184 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpe87a2649-8e5a-4f92-a471-f15e9b33eab4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:53.147268 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:53.191504 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 4438309 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:53.199068 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:53.301417 [ 11406 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:53.345967 [ 3746 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:53.609890 [ 2241 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 5142396 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x00000000343d6317 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x00000000343d5adf in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x00000000345c6dbf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c4485 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ac548 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c726b9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:53.673200 [ 2192 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:53.673253 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.54 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergedColumnOnlyOutputStream.cpp:35: DB::MergedColumnOnlyOutputStream::MergedColumnOnlyOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::Block const&, std::shared_ptr, std::vector, std::allocator>> const&, std::set, std::allocator>*, DB::MergeTreeIndexGranularity const&, DB::MergeTreeIndexGranularityInfo const*) @ 0x00000000345d4876 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTask::VerticalMergeStage::prepareVerticalMergeForOneColumn() const @ 0x0000000033ea317a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba8d8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::VerticalMergeStage::execute() @ 0x0000000033eabd39 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:53.673632 [ 3736 ] {da200cdd-f87f-4680-acad-ef15dc6ba77b} DynamicQueryHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/egm/debmdbpopvgzerdzknacluzkwcyha, hash key: 9c0cea0706f1246c21e64134b28797ea, file_offset_of_buffer_end: 0, read_until_position: 50628, internal buffer end: 50628, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: da200cdd-f87f-4680-acad-ef15dc6ba77b:18522, file segment info: File segment: [0, 50627], key: 9c0cea0706f1246c21e64134b28797ea, state: DOWNLOADING, downloaded size: 0, reserved size: 50628, downloader id: da200cdd-f87f-4680-acad-ef15dc6ba77b:18522, current write offset: 0, caller id: da200cdd-f87f-4680-acad-ef15dc6ba77b:18522, kind: Regular, unbound: 0: (while reading column MobilePhoneModel): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_19_19_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/tuple:533: DB::AsynchronousBoundedReadBuffer::nextImpl() @ 0x000000002dd1f0ef in /usr/bin/clickhouse 20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 21. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec784a9 in /usr/bin/clickhouse 22. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray, 63ul, 64ul>&, DB::PODArray, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x000000002f282da8 in /usr/bin/clickhouse 23. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27dda3 in /usr/bin/clickhouse 24. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:53.679383 [ 11406 ] {1853784d-8845-4236-bb2b-1371799edc93} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:55924) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:53.680955 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:53.688922 [ 2192 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:53.769159 [ 3736 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:53.769207 [ 11406 ] {1853784d-8845-4236-bb2b-1371799edc93} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:53.769605 [ 12113 ] {3276ab37-cfbb-448b-92de-e6a757e2d8bf} executeQuery: Code: 341. DB::Exception: Exception happened during execution of mutation 'mutation_3.txt' with part '1_1_1_0' reason: 'Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build))'. This error maybe retryable or not. In case of unretryable error, mutation can be killed with KILL MUTATION query. (UNFINISHED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:55912) (comment: 00944_clear_index_in_partition.sh) (in query: ALTER TABLE minmax_idx CLEAR INDEX idx IN PARTITION 1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, String&&, String&, String&) @ 0x00000000343bf960 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeMutationStatus.cpp:26: DB::checkMutationStatus(std::optional&, std::set, std::allocator> const&) @ 0x00000000343bf397 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageMergeTree.cpp:0: DB::StorageMergeTree::waitForMutation(long, String const&, bool) @ 0x000000003490eaa1 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::StorageMergeTree::alter(DB::AlterCommands const&, std::shared_ptr, std::unique_lock&) @ 0x0000000034906938 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112cb7d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:53.920892 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4241989 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.280135 [ 2195 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.280516 [ 11326 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.280609 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.280373 [ 2310 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5165377 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cbf959 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.280771 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.280802 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1192480 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_17_17_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a5a2 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.280883 [ 2011 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.284574 [ 12113 ] {3276ab37-cfbb-448b-92de-e6a757e2d8bf} TCPHandler: Code: 341. DB::Exception: Exception happened during execution of mutation 'mutation_3.txt' with part '1_1_1_0' reason: 'Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build))'. This error maybe retryable or not. In case of unretryable error, mutation can be killed with KILL MUTATION query. (UNFINISHED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, String&&, String&, String&) @ 0x00000000343bf960 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/MergeTreeMutationStatus.cpp:26: DB::checkMutationStatus(std::optional&, std::set, std::allocator> const&) @ 0x00000000343bf397 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageMergeTree.cpp:0: DB::StorageMergeTree::waitForMutation(long, String const&, bool) @ 0x000000003490eaa1 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::StorageMergeTree::alter(DB::AlterCommands const&, std::shared_ptr, std::unique_lock&) @ 0x0000000034906938 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112cb7d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:54.284681 [ 2060 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.284937 [ 2000 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.285209 [ 2007 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.285170 [ 1985 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.284988 [ 2192 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.285314 [ 2010 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.285882 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.390434 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp3e0bd66d-d46d-4f3d-9ddb-aba8a8378621' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:54.391414 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.392046 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.468728 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.539218 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.592504 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:84: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b5bc in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.624761 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.631315 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x00000000341744a5 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.691707 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 5164865 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.721464 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.767664 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.775756 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.907778 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp6deb88ab-c56f-41ed-9918-0e80542ea5b9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:54.930763 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.933570 [ 2188 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.934668 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.941213 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp84f70e2c-cce8-46d2-98a4-56ce13e562ce' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:54.941684 [ 2185 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:54.943913 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.045071 [ 2185 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.059295 [ 2185 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.073038 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.079793 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp2fe5e182-ba7a-4a41-b7a3-0b6336276a20' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:55.084132 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.087812 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.101095 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp4436b86e-5b4f-4b45-a405-1282bdb6c9db' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:55.109875 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.135868 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.136526 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.139388 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe656031c-cee8-46c7-8239-d71529763677' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:55.139931 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.143235 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.148207 [ 2188 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.151008 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.158116 [ 2188 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.159659 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpbf46e51e-624a-4c63-b675-5445973aabb5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:55.183100 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.186364 [ 11445 ] {9c3585f1-c035-44c9-8d20-c62284c2415d} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:55950) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:55.187734 [ 2197 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.189729 [ 2197 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.191400 [ 2197 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.191749 [ 11445 ] {9c3585f1-c035-44c9-8d20-c62284c2415d} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:55.217735 [ 2197 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.222699 [ 2197 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.236554 [ 2196 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.238752 [ 2196 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.245036 [ 2196 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.288116 [ 2006 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.288571 [ 2017 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.291260 [ 2087 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.291475 [ 1996 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.292117 [ 2001 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.294386 [ 2041 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.349460 [ 11326 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.358658 [ 2186 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.363009 [ 2186 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.365367 [ 2194 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.402883 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp2343282d-ed63-4ea3-8935-4135ddf17121' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:55.479914 [ 2186 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.479985 [ 2194 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.480456 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.504754 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.516760 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp5c5d5bc1-980d-409c-ade2-21aebf0588f4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:55.517547 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.519978 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpfcbf59ac-a65c-4b39-85ce-0430cdd5011d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:55.520287 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.520367 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.522772 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.530262 [ 2186 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.535700 [ 2186 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.566768 [ 2196 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.569858 [ 2196 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.582814 [ 2196 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.596014 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp6e9f6534-96c7-4af9-a5f4-d97622d310f2' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:55.602275 [ 2188 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.670304 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpa130258b-b6e1-4e58-9fb1-bf6f69d08309' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:55.684054 [ 2195 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.684286 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.684275 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.686228 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.686277 [ 2188 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.734958 [ 2185 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp62c0b95b-61fe-436c-9a36-dd6d1b8f4c40' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:55.741603 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.743505 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp15a73d51-5efe-40c5-bfc0-3821822c94f1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:55.745697 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.745879 [ 2196 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.748267 [ 2196 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.750385 [ 2196 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.763438 [ 2185 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.766168 [ 2185 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.773446 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpefb32014-c521-42b2-88c0-f08e7aaf8984' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:55.774752 [ 2194 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.776165 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.777236 [ 2194 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.788189 [ 2187 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.792178 [ 2187 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.804875 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpbc58cf7e-4b10-4e84-a7f9-c9fd09f4f3f1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:55.807747 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.880729 [ 2194 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.893151 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.895351 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.897074 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.897270 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp05ef4880-234f-4de7-919c-0c5a97d2fa77' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:55.900236 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.933829 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.968093 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.968665 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.968914 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc9b7dba6-8052-48bf-845d-4f53d7fa87d5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:55.969355 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpbc65279d-bc0e-484d-bff7-b6697c5580d1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:55.972217 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.973591 [ 2186 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.974861 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:55.975341 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.076163 [ 11326 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.131503 [ 2186 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.135829 [ 2186 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.137852 [ 2186 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.138851 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp5eeb5f3e-f07a-4c6a-8728-29832ee4182e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:56.144437 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.159035 [ 2196 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.177354 [ 2196 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.186612 [ 2192 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.218042 [ 11445 ] {922fa28b-8a91-4148-8ee0-d1b65d37c2e3} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:55958) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:56.220555 [ 11445 ] {922fa28b-8a91-4148-8ee0-d1b65d37c2e3} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:56.246158 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp8f350fbb-2526-4225-83d9-dc0258eb7fb2' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:56.248671 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.265947 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp8cae888f-fcc4-444d-a17f-13feecc58830' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:56.274064 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.278664 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7331492a-cc71-4c9b-b958-38a77cd26f95' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:56.282197 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.284678 [ 11326 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.293384 [ 2192 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.295607 [ 2192 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.295532 [ 2190 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.297044 [ 2197 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.299386 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.305313 [ 11326 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.309664 [ 2197 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.350311 [ 2005 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.350674 [ 2067 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.351069 [ 2043 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.355689 [ 1995 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.356033 [ 2080 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.356061 [ 2043 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.536480 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpba051e6b-4286-4d79-ae3f-93836d68cf2b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:56.539516 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp4e929a4a-6e55-48d3-8004-fa5c07e67287' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:56.568460 [ 2184 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp0529fff8-0e9c-4544-b673-0c18bd5c1c7a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:56.625047 [ 2247 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 4653190 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cb02d9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.625760 [ 2199 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.631542 [ 2199 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.729221 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.729391 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.730151 [ 2199 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.730332 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.737981 [ 2196 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.775997 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp7a50f928-fa9f-45e4-ad84-3e44e9ac4824' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:56.782674 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp3e0e2941-5f9a-41a6-97df-c9bfdb54ceb4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:56.880047 [ 11992 ] {aeec8f7a-18f1-4aa9-aa01-9cf2c32f5e0b} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1966080 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (avg_value_size_hint = 143.7135009765625, avg_chars_size = 162.856201171875, limit = 8192): (while reading column Title): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_11_11_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 24 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57032) (comment: 00160_decode_xml_component.sql) (in query: SELECT sum(DISTINCT sipHash64(decodeXMLComponent(Title) AS decoded)) FROM test.hits WHERE Title != decoded;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27db01 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 25. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 28. ? @ 0x00007f11b339dac3 in ? 29. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:56.880911 [ 2190 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.883490 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.883942 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.887951 [ 2196 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:56.888723 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.033785 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.080080 [ 11326 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.099799 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp44d607ec-33c7-470c-a5c9-7c763047cc39' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:57.116957 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp1c729249-f362-4509-ae94-948ef67b6639' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:57.124441 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.127466 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.56 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.129359 [ 2192 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.134299 [ 2192 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.142439 [ 2192 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.57 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.179947 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp6d180c97-31d0-4599-9d5b-4d148c9be569' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:57.267733 [ 11992 ] {aeec8f7a-18f1-4aa9-aa01-9cf2c32f5e0b} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1966080 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (avg_value_size_hint = 143.7135009765625, avg_chars_size = 162.856201171875, limit = 8192): (while reading column Title): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_11_11_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 24 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27db01 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 25. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 28. ? @ 0x00007f11b339dac3 in ? 29. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:57.278372 [ 2190 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp67a29156-7ddf-4206-bccf-d969623bbc14' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:57.287436 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp4e1c19b3-6c97-4cf6-a785-1b23e4705192' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:57.315290 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.748325 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 4490407 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 7. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/PODArray.h:321: DB::ColumnString::insert(DB::Field const&) @ 0x00000000326f278b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/TextLog.cpp:71: DB::TextLogElement::appendToBlock(std::vector::mutable_ptr, std::allocator::mutable_ptr>>&) const @ 0x0000000031e5e471 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cedaac in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031ceb946 in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d96ae39 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.751219 [ 12113 ] {94b9dc66-e616-43dd-8c80-b994f271043f} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:55988) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:57.883719 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.60 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.884000 [ 1910 ] {d4f7b939-a964-4aed-91e4-c7c72ac782e8} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.60 GiB (attempt to allocate chunk of 1180038 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/jar/tpxocscduqngtnhkhkyipqtqxectc, hash key: bea405f30a082e7a624f304dedecb6d1, file_offset_of_buffer_end: 0, read_until_position: 3841, internal buffer end: 33180, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: d4f7b939-a964-4aed-91e4-c7c72ac782e8:15332, file segment info: File segment: [0, 33179], key: bea405f30a082e7a624f304dedecb6d1, state: DOWNLOADING, downloaded size: 0, reserved size: 33180, downloader id: d4f7b939-a964-4aed-91e4-c7c72ac782e8:15332, current write offset: 0, caller id: d4f7b939-a964-4aed-91e4-c7c72ac782e8:15332, kind: Regular, unbound: 0: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 4096): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57034) (comment: 00071_merge_tree_optimize_aio.sql) (in query: INSERT INTO test.hits_snippet(EventTime, EventDate, CounterID, UserID, URL, Referer) SELECT EventTime, EventDate, CounterID, UserID, URL, Referer FROM test.hits WHERE EventDate = toDate('2014-03-18') ORDER BY EventTime, EventDate, CounterID, UserID, URL, Referer ASC LIMIT 50;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 19. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x000000002ec749b2 in /usr/bin/clickhouse 20. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec795a1 in /usr/bin/clickhouse 21. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f2182b0 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 2024.10.22 00:32:57.884304 [ 2016 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.884300 [ 2088 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.884333 [ 2027 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.884553 [ 2078 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.884839 [ 2186 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.884616 [ 2009 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.885110 [ 11326 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.885226 [ 2193 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.885119 [ 2077 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.885235 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.885433 [ 12113 ] {94b9dc66-e616-43dd-8c80-b994f271043f} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:57.885378 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.886297 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.890513 [ 2193 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.60 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.892023 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.58 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.893017 [ 2193 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.60 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.940685 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp550162e5-60d3-449c-bf13-ab743fcefa66' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:57.941271 [ 2184 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.945298 [ 2184 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.945530 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.950927 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp9df353e0-ceba-435d-8b1e-e58bdff517a9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:57.962135 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:57.963753 [ 2194 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp38c3944e-dc94-4615-a7e0-1a7038095990' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:57.988073 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.017988 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.60 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.042077 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.60 GiB (attempt to allocate chunk of 5109769 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c53899 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.058012 [ 2184 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.59 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.333064 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp614d5f9f-31ea-4882-a6e0-252bb163d235' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:58.335675 [ 2190 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.64 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.336543 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.64 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.341149 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp992db25f-e304-4b3b-8c8e-a6b636cd6062' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:58.344431 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.62 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.352680 [ 11326 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.63 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.368270 [ 11326 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.63 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.393805 [ 2190 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.64 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.510783 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp258dbd44-9707-417e-a70d-cba1397e9090' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:58.544268 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.567552 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp243ed21c-c85b-4f9f-b7ce-73345cf1e2b5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:58.579073 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.599585 [ 2198 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.72 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.713782 [ 2198 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.740216 [ 2194 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.746389 [ 2198 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.879441 [ 2194 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.886564 [ 2051 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.887596 [ 2071 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.888041 [ 2026 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.889054 [ 1978 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.889688 [ 2025 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.896524 [ 2079 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.949423 [ 2185 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.953035 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp78e01934-2a5d-4b9d-914b-ccadd2641dbd' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:58.974049 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.975606 [ 2185 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.76 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.981932 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.988807 [ 2193 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.76 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.989701 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.76 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:58.990055 [ 2195 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp5660d0b4-9129-4082-b76f-43630b0b13ca' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:58.991947 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp594070c7-0d66-4d12-93be-dee2bb057668' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:32:59.002610 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.76 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:59.081326 [ 11326 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.78 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:59.104286 [ 2185 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.76 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:59.105329 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:59.106063 [ 12113 ] {003e486c-0160-4dfe-90a1-ea5b8b08760f} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56002) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:59.222526 [ 12113 ] {003e486c-0160-4dfe-90a1-ea5b8b08760f} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:32:59.500506 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.78 GiB (attempt to allocate chunk of 4585281 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:59.901994 [ 2087 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:59.902477 [ 1989 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:59.902970 [ 2058 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:59.903393 [ 2095 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:59.915880 [ 2003 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:32:59.946981 [ 2059 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:00.375839 [ 11326 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.89 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:00.387406 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.89 GiB (attempt to allocate chunk of 4220522 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:00.452263 [ 14378 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.89 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:00.480910 [ 12113 ] {73e46aee-d933-4353-b5b5-79f4c12ab0e8} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41778) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:00.499578 [ 12113 ] {73e46aee-d933-4353-b5b5-79f4c12ab0e8} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:00.903532 [ 2040 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:00.905323 [ 2100 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:00.912620 [ 1977 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:00.916548 [ 2038 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:00.937915 [ 1975 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:00.969998 [ 1990 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:01.420194 [ 1910 ] {d4f7b939-a964-4aed-91e4-c7c72ac782e8} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.60 GiB (attempt to allocate chunk of 1180038 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/jar/tpxocscduqngtnhkhkyipqtqxectc, hash key: bea405f30a082e7a624f304dedecb6d1, file_offset_of_buffer_end: 0, read_until_position: 3841, internal buffer end: 33180, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: d4f7b939-a964-4aed-91e4-c7c72ac782e8:15332, file segment info: File segment: [0, 33179], key: bea405f30a082e7a624f304dedecb6d1, state: DOWNLOADING, downloaded size: 0, reserved size: 33180, downloader id: d4f7b939-a964-4aed-91e4-c7c72ac782e8:15332, current write offset: 0, caller id: d4f7b939-a964-4aed-91e4-c7c72ac782e8:15332, kind: Regular, unbound: 0: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 4096): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 19. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x000000002ec749b2 in /usr/bin/clickhouse 20. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec795a1 in /usr/bin/clickhouse 21. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f2182b0 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 2024.10.22 00:33:01.464266 [ 2559 ] {57eeabe2-9a05-4cb8-b703-0a9ce628be3e} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41784) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:01.479582 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:01.508014 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb6a956a3-25e6-4af2-bb78-d9352151580b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:01.510216 [ 2184 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpda8cb248-1588-4652-a542-9e3465ad0585' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:01.520201 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp33f625e5-c897-4965-96b9-e0d337223613' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:01.612913 [ 11445 ] {25bc2e09-ccaa-4212-bbc7-10b520110ccd} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.63 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:55978) (comment: 01162_strange_mutations.sh) (in query: CREATE TABLE test ENGINE = ReplicatedMergeTree('/test/01162/01162_strange_mutations_test_3', '1') ORDER BY n SETTINGS index_granularity = 17874, min_bytes_for_wide_part = 600111412, ratio_of_defaults_for_sparse_serialization = 0.26116105914115906, merge_max_block_size = 21058, prefer_fetch_merged_part_size_threshold = 35731013, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 9179611331, index_granularity_bytes = 23056833, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 11444, primary_key_compress_block_size = 12682 AS SELECT number + 100 AS n, 0 AS test FROM numbers(50)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:801: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x0000000034855f27 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 2024.10.22 00:33:01.670413 [ 2559 ] {57eeabe2-9a05-4cb8-b703-0a9ce628be3e} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:01.670535 [ 11440 ] {139a9ba6-6f2e-4ee0-b7a0-374cfe64302b} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.61 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:55948) (comment: 01107_atomic_db_detach_attach.sh) (in query: SELECT count(n), sum(n) FROM test_01107.mt), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:01.671402 [ 2196 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:01.671998 [ 14378 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.80 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:01.671487 [ 3096 ] {105b3f31-8042-4a10-a229-2cb3ecb63999} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.78 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56012) (comment: 00944_clear_index_in_partition.sh) (in query: ALTER TABLE minmax_idx MATERIALIZE INDEX idx IN PARTITION 1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeMutationEntry.cpp:0: DB::MergeTreeMutationEntry::MergeTreeMutationEntry(DB::MutationCommands, std::shared_ptr, String const&, unsigned long, DB::TransactionID const&, DB::WriteSettings const&) @ 0x000000003496fda3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:491: DB::StorageMergeTree::startMutation(DB::MutationCommands const&, std::shared_ptr) @ 0x0000000034908b02 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::StorageMergeTree::mutate(DB::MutationCommands const&, std::shared_ptr) @ 0x0000000034910ea5 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112be20 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:01.672560 [ 14377 ] {4a278b52-b286-4e29-a9a5-b7978dbc9551} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.61 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46858) (comment: 00074_full_join.sql) (in query: SELECT CounterID, hits, visits FROM ( SELECT (CounterID % 100000) AS CounterID, count() AS hits FROM test.hits GROUP BY CounterID ) ANY FULL OUTER JOIN ( SELECT (CounterID % 100000) AS CounterID, sum(Sign) AS visits FROM test.visits GROUP BY CounterID HAVING visits > 0 ) USING CounterID WHERE hits = 0 OR visits = 0 ORDER BY hits + visits * 10 DESC, CounterID ASC LIMIT 20;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:01.673266 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.76 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:01.675549 [ 11445 ] {25bc2e09-ccaa-4212-bbc7-10b520110ccd} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.63 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:801: DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x0000000034855f27 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 2024.10.22 00:33:01.676283 [ 11440 ] {139a9ba6-6f2e-4ee0-b7a0-374cfe64302b} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.61 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:01.679350 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.76 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:01.679666 [ 2196 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.84 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:01.690450 [ 2196 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.84 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:01.696408 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:01.697232 [ 3096 ] {105b3f31-8042-4a10-a229-2cb3ecb63999} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.78 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeMutationEntry.cpp:0: DB::MergeTreeMutationEntry::MergeTreeMutationEntry(DB::MutationCommands, std::shared_ptr, String const&, unsigned long, DB::TransactionID const&, DB::WriteSettings const&) @ 0x000000003496fda3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:491: DB::StorageMergeTree::startMutation(DB::MutationCommands const&, std::shared_ptr) @ 0x0000000034908b02 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::StorageMergeTree::mutate(DB::MutationCommands const&, std::shared_ptr) @ 0x0000000034910ea5 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112be20 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:01.713356 [ 14377 ] {4a278b52-b286-4e29-a9a5-b7978dbc9551} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.61 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:01.807509 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 5079621 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:01.810359 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:01.817868 [ 14378 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.84 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:01.818978 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:01.880405 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpa7e15a84-7520-4ba8-ab64-af2853dceb55' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:01.880958 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp4cd4d8de-a19a-4b1c-8ef8-c6706dd232f9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:02.298222 [ 2241 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.84 GiB (attempt to allocate chunk of 5045473 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c726b9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.431756 [ 2197 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.84 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.431812 [ 11885 ] {ac1ef893-ba12-453c-b5ce-5707ed1de674} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.76 GiB (attempt to allocate chunk of 1049706 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:34178) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.432509 [ 2049 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.432708 [ 2060 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.432709 [ 1987 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.432844 [ 2028 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.433018 [ 1992 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.432698 [ 2090 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.433196 [ 14378 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.435644 [ 11886 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.445948 [ 2197 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.450076 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.84 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.450125 [ 2191 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.84 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.450288 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.84 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.450613 [ 2197 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.451708 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.84 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.465772 [ 3746 ] {355d58e3-7655-4d2f-9a94-7dbc92367c38} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.77 GiB (attempt to allocate chunk of 1050210 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:52844) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.466179 [ 3740 ] {3799c554-d5c9-4a31-8f67-d78ad3afd470} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.78 GiB (attempt to allocate chunk of 1050210 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:59110) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.466774 [ 11388 ] {904b5e2a-ca35-4f79-831b-e274acdc19de} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1049706 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:40998) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.467022 [ 11976 ] {37b1c53c-8a5f-4e94-a0df-d896f7305b90} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1049706 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:49896) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.467260 [ 11386 ] {343ff694-b80a-42c5-b576-65e042809922} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.78 GiB (attempt to allocate chunk of 1049706 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:41654) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.476204 [ 2188 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.483744 [ 11915 ] {38aa270c-b670-4909-9f4f-2281f693ee8a} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.78 GiB (attempt to allocate chunk of 1049706 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:38228) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.484050 [ 11358 ] {22bf0b28-a3db-4c51-905d-45a71252428e} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.78 GiB (attempt to allocate chunk of 1049706 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:44276) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.512288 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp00476cd8-c7a5-4bb6-855b-5c1a2eedb7c8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:02.523760 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp19cac80f-b236-460a-89a9-2c67e02bddf5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:02.538531 [ 2188 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.539236 [ 11406 ] {90977287-9e77-4675-9916-9762ea8468e9} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1195454 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/sum/fksttwesaaqbnugixwddewprodjsj, hash key: 1cfb44a7ae1e2a7504ebe936ae1d4898, file_offset_of_buffer_end: 0, read_until_position: 590, internal buffer end: 24113, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 90977287-9e77-4675-9916-9762ea8468e9:18457, file segment info: File segment: [0, 24112], key: 1cfb44a7ae1e2a7504ebe936ae1d4898, state: DOWNLOADING, downloaded size: 0, reserved size: 24113, downloader id: 90977287-9e77-4675-9916-9762ea8468e9:18457, current write offset: 0, caller id: 90977287-9e77-4675-9916-9762ea8468e9:18457, kind: Regular, unbound: 0: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_21_21_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:57696) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/tuple:533: DB::AsynchronousBoundedReadBuffer::nextImpl() @ 0x000000002dd1f0ef in /usr/bin/clickhouse 20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x000000002ec749b2 in /usr/bin/clickhouse 21. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec795a1 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f2182b0 in /usr/bin/clickhouse 23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a7ef9 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 2024.10.22 00:33:02.539232 [ 11358 ] {22bf0b28-a3db-4c51-905d-45a71252428e} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.78 GiB (attempt to allocate chunk of 1049706 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.538860 [ 11976 ] {37b1c53c-8a5f-4e94-a0df-d896f7305b90} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1049706 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.540512 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.540592 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.569070 [ 11886 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.618701 [ 11915 ] {38aa270c-b670-4909-9f4f-2281f693ee8a} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.78 GiB (attempt to allocate chunk of 1049706 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.624466 [ 11388 ] {904b5e2a-ca35-4f79-831b-e274acdc19de} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1049706 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.639467 [ 3746 ] {355d58e3-7655-4d2f-9a94-7dbc92367c38} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.77 GiB (attempt to allocate chunk of 1050210 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.647949 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 4547109 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.648500 [ 3740 ] {3799c554-d5c9-4a31-8f67-d78ad3afd470} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.78 GiB (attempt to allocate chunk of 1050210 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.649092 [ 11852 ] {bfa81599-3a3f-48e1-8637-a6401dc8006c} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.78 GiB (attempt to allocate chunk of 1049706 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:39016) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `CounterID`, quantileTiming(0.5)(`SendTiming`), count() FROM `test`.`hits` WHERE `SendTiming` != -1 GROUP BY `CounterID`), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.669294 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp02007fc8-1f3f-4f3f-965e-f490c548ed48' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:02.677229 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.87 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.699804 [ 11325 ] {a181975d-c1ea-4bc5-a6ae-e34d6382a48a} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41818) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.747482 [ 11325 ] {a181975d-c1ea-4bc5-a6ae-e34d6382a48a} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.756111 [ 2184 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp1276deaa-2fe2-4701-a883-ee023b5e2c04' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:02.760781 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.85 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.763698 [ 11386 ] {343ff694-b80a-42c5-b576-65e042809922} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.78 GiB (attempt to allocate chunk of 1049706 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.770756 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp40f2a392-4935-4915-882b-740c768ac245' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:02.774325 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.789761 [ 2190 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.793295 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.798048 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.801042 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.801219 [ 2190 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.807812 [ 11885 ] {ac1ef893-ba12-453c-b5ce-5707ed1de674} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.76 GiB (attempt to allocate chunk of 1049706 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.812479 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp67e15860-b7b2-4afe-8bcd-1ed26778dc28' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:02.815882 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.81 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.820202 [ 11886 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.80 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.836322 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp30b277d9-ab13-4d4a-abca-cb119751b9f1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:02.852834 [ 11406 ] {90977287-9e77-4675-9916-9762ea8468e9} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1195454 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/sum/fksttwesaaqbnugixwddewprodjsj, hash key: 1cfb44a7ae1e2a7504ebe936ae1d4898, file_offset_of_buffer_end: 0, read_until_position: 590, internal buffer end: 24113, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 90977287-9e77-4675-9916-9762ea8468e9:18457, file segment info: File segment: [0, 24112], key: 1cfb44a7ae1e2a7504ebe936ae1d4898, state: DOWNLOADING, downloaded size: 0, reserved size: 24113, downloader id: 90977287-9e77-4675-9916-9762ea8468e9:18457, current write offset: 0, caller id: 90977287-9e77-4675-9916-9762ea8468e9:18457, kind: Regular, unbound: 0: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_21_21_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/tuple:533: DB::AsynchronousBoundedReadBuffer::nextImpl() @ 0x000000002dd1f0ef in /usr/bin/clickhouse 20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x000000002ec749b2 in /usr/bin/clickhouse 21. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec795a1 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f2182b0 in /usr/bin/clickhouse 23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a7ef9 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 2024.10.22 00:33:02.852982 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.80 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.888714 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.80 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.896519 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.80 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.908324 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp3be416c6-c14d-4b25-a6b1-da3d033b9599' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:02.908490 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.80 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.914928 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.80 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.917377 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp39e77d4a-a968-4d2b-9e03-2ff6fcd985ee' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:02.918537 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.81 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.925077 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.79 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.925352 [ 11852 ] {bfa81599-3a3f-48e1-8637-a6401dc8006c} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.78 GiB (attempt to allocate chunk of 1049706 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:02.936355 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.79 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.946199 [ 2189 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.79 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.977627 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpdd590e72-f89a-4624-b2f5-f0986ade848b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:02.989298 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 5164865 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:02.999007 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.79 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.116175 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc9198c4e-12d9-4112-811f-642dcb5a1756' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:03.234692 [ 2188 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.234871 [ 11357 ] {9aea052e-632b-4e7c-9faf-8f5fd327a93b} executeQuery: Code: 241. DB::Exception: Received from 127.0.0.5:9000. DB::Exception: Memory limit (total) exceeded: would use 15.78 GiB (attempt to allocate chunk of 1049706 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. Stack trace: 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? : While executing Remote. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:55934) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT sum(cityHash64(*)) FROM (SELECT CounterID, quantileTiming(0.5)(SendTiming), count() FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9,10}', test.hits) WHERE SendTiming != -1 GROUP BY CounterID);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x000000001d7167e4 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x0000000034c029ec in /usr/bin/clickhouse 4. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::receivePacket() @ 0x0000000034c17b8e in /usr/bin/clickhouse 5. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function, std::function) @ 0x0000000034cbbc1d in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x000000002edcf826 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: boost::context::detail::fiber_capture_record>::run() @ 0x000000002edcec1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func>>(unsigned int, unsigned int) @ 0x000000002edcc7d4 in /usr/bin/clickhouse 2024.10.22 00:33:03.249243 [ 2188 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.252884 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.369183 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.369700 [ 11406 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:57696). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000001dd67cf6 in /usr/bin/clickhouse 3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000001dd66139 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x0000000034ed576e in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.369878 [ 11891 ] {631923fa-a24f-4e8f-8c44-f378c2775384} executeQuery: Code: 36. DB::Exception: ALTER UPDATE/ALTER DELETE statement with subquery may be nondeterministic, see allow_nondeterministic_mutations setting. (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41836) (comment: 01162_strange_mutations.sh) (in query: ALTER TABLE test UPDATE test = (SELECT groupArray(id) FROM t1 GROUP BY 'dummy')[n - 99] WHERE 1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [120]) @ 0x000000002eded709 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/MutationsInterpreter.cpp:0: DB::MutationsInterpreter::validate() @ 0x00000000318328c9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:178: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112bbd4 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:03.370445 [ 2190 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.370580 [ 2188 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.370700 [ 11357 ] {9aea052e-632b-4e7c-9faf-8f5fd327a93b} TCPHandler: Code: 241. DB::Exception: Received from 127.0.0.5:9000. DB::Exception: Memory limit (total) exceeded: would use 15.78 GiB (attempt to allocate chunk of 1049706 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 3 with max_rows_to_read = 2886): While executing MergeTreeInOrder. Stack trace: 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89153 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? : While executing Remote. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x000000001d7167e4 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x0000000034c029ec in /usr/bin/clickhouse 4. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::receivePacket() @ 0x0000000034c17b8e in /usr/bin/clickhouse 5. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function, std::function) @ 0x0000000034cbbc1d in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x000000002edcf826 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: boost::context::detail::fiber_capture_record>::run() @ 0x000000002edcec1f in /usr/bin/clickhouse 8. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func>>(unsigned int, unsigned int) @ 0x000000002edcc7d4 in /usr/bin/clickhouse 2024.10.22 00:33:03.371469 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.374236 [ 11891 ] {631923fa-a24f-4e8f-8c44-f378c2775384} TCPHandler: Code: 36. DB::Exception: ALTER UPDATE/ALTER DELETE statement with subquery may be nondeterministic, see allow_nondeterministic_mutations setting. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [120]) @ 0x000000002eded709 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/MutationsInterpreter.cpp:0: DB::MutationsInterpreter::validate() @ 0x00000000318328c9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:178: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112bbd4 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:03.380578 [ 11886 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.90 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.409223 [ 2191 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.411767 [ 2194 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpa3652e94-8ffe-497d-8cd6-ff4d562585be' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:03.418994 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.90 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.434397 [ 2006 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.435298 [ 2087 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.435839 [ 2020 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.435851 [ 2058 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.436860 [ 2095 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.437228 [ 2006 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.448334 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.90 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.484816 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp74b250bf-becd-437b-8f7a-b71bcb4f3cc7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:03.500533 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.89 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.501803 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp47ad99d2-b67c-4d6e-8447-cfb237d740e7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:03.506769 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.89 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.571532 [ 2188 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.89 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.576689 [ 2188 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.89 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.578358 [ 2188 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.89 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.703184 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp14aad5df-8ea7-45f8-839c-219bc31f6af0' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:03.704866 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpf766978e-8fed-4f79-9ee8-217aea26caf9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:03.706935 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.89 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.707688 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.89 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.744071 [ 14378 ] {519cae24-9ef3-4230-aa19-6e10069d3afb} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41852) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:03.748187 [ 14378 ] {519cae24-9ef3-4230-aa19-6e10069d3afb} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:03.818239 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.89 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.819028 [ 2185 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.90 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.910867 [ 2194 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp27dc1b08-4877-4709-8f92-eed460e56ca6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:03.914322 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.90 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.939249 [ 2199 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.90 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.941860 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.90 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.952886 [ 2185 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.90 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.957340 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp11f41a59-45e2-4ab1-a20a-c2cd7270ead6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:03.969057 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.90 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:03.974584 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.90 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.001265 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp43935429-47bc-4e2e-a39d-7069200ce2a0' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.003596 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.050987 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp496d00f2-b423-4946-96be-4ee763d1f52f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.054364 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp5c9b11ef-ded5-4df2-99bd-f858900db708' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.055455 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.056909 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.058179 [ 2193 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp9a21a67c-93e6-465c-a219-11c3a66424ff' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.062187 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.083606 [ 2184 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual void DB::MetadataStorageFromDiskTransaction::commit(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.92 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::execute(std::unique_lock&) @ 0x000000002f4f6b3a in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::CreateHardlinkOperation::execute(std::unique_lock&) @ 0x000000002f4f609e in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4daeec in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.092682 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc63046de-cb16-421b-bb1a-143ffb28ba54' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.096131 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.92 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.097024 [ 2197 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.92 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.104109 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp0859bb40-5814-4672-94e0-3783799dc868' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.106379 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.92 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.114173 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp808413f6-fc62-4a06-a835-448535d768bf' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.117480 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.92 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.135713 [ 2197 ] {8b057dff-6d75-489b-b34c-472f496fbac8::1_1_1_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.92 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MutateAllPartColumnsTask::prepare() @ 0x0000000034638822 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1246: DB::MutateAllPartColumnsTask::executeStep() @ 0x000000003463356d in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1754: DB::MutateTask::execute() @ 0x00000000345f39ff in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.169154 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp9302bdff-f52b-40ea-9bfc-b0c4f13c21df' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.174406 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.92 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.192781 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpdc9eab0d-eab6-4ad8-a3c0-885d2dd6ad78' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.192865 [ 2184 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} MutatePlainMergeTreeTask: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.92 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.325993 [ 11851 ] {5654c162-779d-4c44-a657-f13855ef07b6} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1074877 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/84f/84f788e2-4f4e-45fa-bf6b-97219cb78fa2/201403_2_2_0/ in table test.visits (84f788e2-4f4e-45fa-bf6b-97219cb78fa2) located on disk s3_disk of type s3, from mark 20 with max_rows_to_read = 19659): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41880) (comment: 00023_totals_limit.sql) (in query: SELECT goals_alias.ID AS `ym:s:goalDimension`, uniqIf(UserID, (UserID != 0) AND (`_uniq_Goals` = 1)) FROM test.visits ARRAY JOIN Goals AS goals_alias, arrayEnumerateUniq(Goals.ID) AS `_uniq_Goals` WHERE (CounterID = 842440) GROUP BY `ym:s:goalDimension` WITH TOTALS ORDER BY `ym:s:goalDimension` LIMIT 0, 1 FORMAT JSONCompact;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 2024.10.22 00:33:04.392224 [ 2184 ] {8b057dff-6d75-489b-b34c-472f496fbac8::2_2_2_0_3} virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.92 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While rolling back operation #0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:0: DB::WriteFileOperation::undo() @ 0x000000002f4f739e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDiskTransactionOperations.cpp:194: DB::CreateHardlinkOperation::undo() @ 0x000000002f4f718a in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:225: DB::MetadataStorageFromDiskTransaction::rollback(unsigned long) @ 0x000000002f4dbc48 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/ObjectStorages/MetadataStorageFromDisk.cpp:199: DB::MetadataStorageFromDiskTransaction::commit() @ 0x000000002f4db892 in /usr/bin/clickhouse 19. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::commit() @ 0x000000002f585a5f in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DiskObjectStorage::createHardLink(String const&, String const&, bool) @ 0x000000002f525cd6 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:0: DB::(anonymous namespace)::localBackupImpl(std::shared_ptr const&, DB::IDiskTransaction*, String const&, String const&, bool, unsigned long, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&) @ 0x00000000348dd329 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/localBackup.cpp:157: DB::localBackup(std::shared_ptr const&, String const&, String const&, bool, std::optional, bool, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr) @ 0x00000000348daa21 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskBase.cpp:428: DB::DataPartStorageOnDiskBase::freeze(String const&, String const&, std::function const&)>, DB::IDataPartStorage::ClonePartParams const&) const @ 0x0000000033d039dc in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::cloneAndLoadDataPartOnSameDisk(std::shared_ptr const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr const&, DB::IDataPartStorage::ClonePartParams const&) @ 0x0000000034035813 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1865: DB::MutateTask::prepare() @ 0x00000000346056ce in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MutateTask.cpp:1744: DB::MutateTask::execute() @ 0x00000000345f38bf in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MutatePlainMergeTreeTask.cpp:90: DB::MutatePlainMergeTreeTask::executeStep() @ 0x000000003499987f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.392275 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.392544 [ 11851 ] {5654c162-779d-4c44-a657-f13855ef07b6} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1074877 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/84f/84f788e2-4f4e-45fa-bf6b-97219cb78fa2/201403_2_2_0/ in table test.visits (84f788e2-4f4e-45fa-bf6b-97219cb78fa2) located on disk s3_disk of type s3, from mark 20 with max_rows_to_read = 19659): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 2024.10.22 00:33:04.392056 [ 2247 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 4222371 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a023 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cb02d9 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031caddc6 in /usr/bin/clickhouse 25. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d967679 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 28. ? @ 0x00007f11b339dac3 in ? 29. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.414340 [ 2187 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.92 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.416283 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.92 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.428232 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp37040a94-2ad2-4384-99f1-fd30deea02f4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.434011 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp4fb5e2dc-9376-4542-8954-13f9abe0c532' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.437361 [ 2069 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.437513 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.437834 [ 2023 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.438452 [ 2002 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.448900 [ 2021 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.449334 [ 2070 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.449766 [ 2032 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.547344 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.572784 [ 11886 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.593362 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp757853d9-5dfd-4d71-b8f5-2c8dd15e8d33' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.603075 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.619920 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp6349d0f3-bb1e-4151-a960-013e1f42c89a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.626333 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.635311 [ 2194 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp9e8d422c-04f3-4c02-aaf0-c650a75ae7dd' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.638663 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.676346 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpcf26f57e-c040-460c-b60a-266a37320140' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.677052 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp1d42f6f0-45ec-409f-878e-c346e7ca806a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.683652 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.688662 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.697571 [ 2197 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.699850 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.730653 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp1fdc58d4-cc0d-43a9-ad91-88444b87dcf3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.734408 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.748080 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp13dc3f9b-b0e6-44b9-8967-607f9b59c254' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.748203 [ 11325 ] {4e983a45-049c-4f29-8d77-49e8f0f5f93e} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41934) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:04.751760 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.785409 [ 11325 ] {4e983a45-049c-4f29-8d77-49e8f0f5f93e} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:04.817488 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpdb4b1dd0-0c4a-4a45-aa53-3b4b201de307' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.822153 [ 11886 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.828608 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.936301 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe7471a35-85db-4e42-8205-46347bbc513c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.936568 [ 2189 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp01eccdda-996c-47bd-a73d-a916e4edcb5d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.938512 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.939553 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:04.965912 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp1f15fd81-4d34-46aa-ad8b-bbf6d985198d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:04.972154 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.017991 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.088236 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb93d7d40-83d2-45cf-af9c-0a7bb1d60275' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:05.090958 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.112037 [ 2187 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.115746 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.119985 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp3beb434c-672f-4dcb-9778-a568f0621a4d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:05.123654 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.209138 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp292bc7ae-da9b-4934-809b-10794450a829' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:05.211709 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.230622 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp17314ea0-da09-4745-9713-53dd51decf80' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:05.233286 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.254902 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp66cbbc0a-3d2a-4dd1-8ae8-370a6388060a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:05.260102 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.263998 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp8668a6fc-bb20-424f-812b-b0b61594cee1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:05.266745 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.293738 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp43a3a048-6a90-4ce8-8c5a-db7ee4768241' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:05.320257 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.321007 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpade9a3e0-03db-4dbf-a444-06914e9e26fc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:05.328185 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.334876 [ 2186 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.336915 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.439864 [ 2103 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.440317 [ 2083 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.440545 [ 2041 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.451537 [ 2057 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.451962 [ 2104 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.462122 [ 2072 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.571991 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp5124ba8f-2c6a-496f-88a1-57adbe957063' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:05.581252 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.588041 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp22e8d5ac-fa96-4891-affd-522504366826' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:05.594768 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.679518 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp6d247ee2-15ff-47a6-9760-9a910f8d3cf6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:05.680216 [ 2191 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.681977 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.684925 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.698675 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpe08cf6dd-170d-4a27-b16b-04f0fe7d8185' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:05.700549 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.708362 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 5110697 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c53899 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.718216 [ 11325 ] {2b4d2d35-fa3d-4b36-85b1-aec9d3a65632} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41950) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:05.751219 [ 11325 ] {2b4d2d35-fa3d-4b36-85b1-aec9d3a65632} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:05.803836 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.93 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:05.872919 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpec7db3e0-242a-4fcd-a5b3-cee913a076e3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:05.875447 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.095208 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd0d74898-da40-43b3-94a8-9d45df921910' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:06.102058 [ 11886 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.116567 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.94 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.124386 [ 2194 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp094d384a-60ed-4576-9ce4-257a98ab1c99' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:06.132125 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.139298 [ 2191 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.141012 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.144025 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp108f03b4-3d3a-4e8d-822d-97472b72ea11' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:06.148345 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.334443 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb8807a79-90b7-4723-a834-065e8a704c3e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:06.442048 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.442516 [ 2034 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.442861 [ 2053 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.442984 [ 2046 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.453569 [ 2039 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.464573 [ 2044 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.466574 [ 2106 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.469412 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp15ca80d7-24a6-493f-aa03-7557c179f936' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:06.470761 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp75c2bed0-ecc5-409b-844a-8bc2a88ad12b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:06.481752 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.482950 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.609417 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc607353f-3c85-4358-944f-b7d97f468613' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:06.611549 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.617514 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc68f5f3c-73d6-40d7-bd2e-18e6de01d899' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:06.619105 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.632454 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpf7f41673-fc6f-461d-8087-136e1115c180' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:06.641208 [ 2190 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.647736 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.648027 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.677494 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 4486055 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 7. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/PODArray.h:321: DB::ColumnString::insert(DB::Field const&) @ 0x00000000326f278b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/TextLog.cpp:71: DB::TextLogElement::appendToBlock(std::vector::mutable_ptr, std::allocator::mutable_ptr>>&) const @ 0x0000000031e5e471 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cedaac in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031ceb946 in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d96ae39 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.804128 [ 11325 ] {a7e9384d-19e2-45bd-9909-074c38288f53} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41964) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:06.812163 [ 11325 ] {a7e9384d-19e2-45bd-9909-074c38288f53} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:06.858055 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp335e2e7e-f107-4f17-a465-c8a2aca2db65' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:06.861881 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.902879 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp65f1aac1-ec01-484d-b85a-e21c2e9dfe17' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:06.905937 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.930612 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp3dd96ee9-52ef-4b18-b55b-46e08f6b4dcc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:06.936702 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:06.984433 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.035659 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpab364e9c-be51-429b-a7eb-a7d7699c9b37' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:07.037768 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.052281 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp6fd0ae6b-7e69-44ab-aeda-3bdbb4e6c542' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:07.054120 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.108118 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 4396865 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.167153 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp518f7e00-edad-4783-813e-ee7fdb4b9481' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:07.169562 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.175637 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp53c4b205-fdba-47a4-97bc-e3ae49aa883c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:07.177783 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.260120 [ 2199 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.261053 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.387113 [ 11886 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.445179 [ 1984 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.445689 [ 2082 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.446252 [ 2042 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.455513 [ 2085 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.467841 [ 2022 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.470461 [ 2099 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.577737 [ 11886 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.598037 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp04bdf16e-d691-427c-b94d-6740d0dee97c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:07.609445 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.617488 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 4270682 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.688275 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp4e436119-bda0-490b-9e0d-fca9cb166e8a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:07.699989 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.715472 [ 2197 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpe7ee9873-b579-414e-b2f5-b65c52056f5d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:07.716185 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpba1e86c7-d087-4ef4-9c02-dd1f0711c3a1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:07.719889 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.719288 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.722583 [ 11325 ] {d87a8d2f-f2d7-42ec-855a-ade5287665e2} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41976) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:07.727570 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.727790 [ 11325 ] {d87a8d2f-f2d7-42ec-855a-ade5287665e2} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:07.783810 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpea8c86c5-59a9-4f3a-a9fa-bafbc3803c3e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:07.792944 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.825162 [ 11886 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.881642 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpa06c70fd-de5f-4c4c-b72f-827c32dcdda4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:07.894658 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.924079 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp0197230a-b017-49c0-8b33-b02d0cd2055f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:07.946536 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.947632 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp9116a47c-af43-4d52-afa2-701990d749c4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:07.950292 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.975026 [ 2197 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:07.978576 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.014325 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp923af51d-6c8f-432c-a0eb-c0e8f3d8b8e9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:08.019427 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.073592 [ 2185 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp04d75860-e6dd-48dd-b54d-833fcc8418e3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:08.076986 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.083919 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7206cfea-0785-4885-8393-cea08478ac24' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:08.086274 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.212488 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpded8efba-180d-4d74-8f2b-c6c1c484ddcf' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:08.212532 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp5f02da54-21c0-4da2-a4cc-81d1ccf43220' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:08.216294 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.216691 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.248091 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp895a8b20-dc3f-4a4c-8a2b-adf9b4897c39' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:08.250213 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.281074 [ 2189 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.282863 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.341340 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmpba888eca-8624-4403-a4d9-e8da8b7e07da' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:08.354117 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.447881 [ 2007 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.448404 [ 1985 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.449174 [ 2010 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.457180 [ 2081 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.469544 [ 2076 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.482730 [ 2075 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.524567 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp51865f85-8236-48a6-bb4d-be73953decd8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:08.526829 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.570825 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp15efea2f-8e9e-40c8-be7b-947f262847ec' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:08.573304 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.606984 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp6ef3a8e8-75a4-415e-b404-19f28921bfb3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:08.615876 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.687613 [ 11325 ] {97871358-0cf7-4015-b2ab-49d10b3e9584} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41986) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:08.690601 [ 11325 ] {97871358-0cf7-4015-b2ab-49d10b3e9584} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:08.701530 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp38498b11-bf71-43c1-a0e3-728a2fc037c8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:08.712390 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.734237 [ 2197 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.741564 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.755026 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp6b104805-bcb3-4e37-a245-4311da156bb1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:08.766110 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.805679 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.807236 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7848dcfe-a844-4a52-a943-c8445d7f1d0b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:08.823591 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:08.886750 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp85853780-3a35-4596-bc67-dd16e4027488' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:09.010572 [ 11851 ] {7618cff5-92d9-45c5-beca-fae153da5172} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1285849 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ResolutionWidth): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41954) (comment: 00082_quantiles.sql) (in query: SELECT CounterID AS k, quantileExact(0.5)(ResolutionWidth) FROM test.hits GROUP BY k ORDER BY count() DESC, CounterID LIMIT 10;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker::__call_impl const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034448e97 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034443992 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x0000000034443033 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:88: DB::MergeTreeReaderWide::prefetchBeginOfRange(Priority) @ 0x0000000034442934 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: std::__packaged_task_func>> (DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)> DB::threadPoolCallbackRunner>, DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, Priority) const::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::operator()(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::'lambda'(), std::allocator>> (DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)> DB::threadPoolCallbackRunner>, DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, Priority) const::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::operator()(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::'lambda'()>, std::unique_ptr> ()>::operator()() @ 0x0000000035d527ee in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task> ()>::operator()() @ 0x0000000035d5bfcc in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? 2024.10.22 00:33:09.023110 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.025117 [ 11851 ] {7618cff5-92d9-45c5-beca-fae153da5172} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/efn/nvizaumdylbmlxaarmgtgutxeyvah, hash key: 2aa6ed7a5f97fc4e2bccac30f1afe5b6, file_offset_of_buffer_end: 0, read_until_position: 278933, internal buffer end: 278933, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 7618cff5-92d9-45c5-beca-fae153da5172:9550, file segment info: File segment: [0, 278932], key: 2aa6ed7a5f97fc4e2bccac30f1afe5b6, state: DOWNLOADING, downloaded size: 0, reserved size: 278933, downloader id: 7618cff5-92d9-45c5-beca-fae153da5172:9550, current write offset: 0, caller id: 7618cff5-92d9-45c5-beca-fae153da5172:9550, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.043244 [ 11851 ] {7618cff5-92d9-45c5-beca-fae153da5172} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/rqk/lucyulumrxbkbtcdwuyprgjntkgta, hash key: f61d40ab8bf6dddf0349dac933a47e0c, file_offset_of_buffer_end: 0, read_until_position: 241425, internal buffer end: 241425, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 7618cff5-92d9-45c5-beca-fae153da5172:9431, file segment info: File segment: [0, 241424], key: f61d40ab8bf6dddf0349dac933a47e0c, state: DOWNLOADING, downloaded size: 0, reserved size: 241425, downloader id: 7618cff5-92d9-45c5-beca-fae153da5172:9431, current write offset: 0, caller id: 7618cff5-92d9-45c5-beca-fae153da5172:9431, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.084478 [ 11851 ] {7618cff5-92d9-45c5-beca-fae153da5172} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/khe/rgbywpnpzcnxbvruqoivrphosnptr, hash key: 4b242bb8e794a15ceb0b462ac56fff98, file_offset_of_buffer_end: 0, read_until_position: 260110, internal buffer end: 260110, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 7618cff5-92d9-45c5-beca-fae153da5172:2338, file segment info: File segment: [0, 260109], key: 4b242bb8e794a15ceb0b462ac56fff98, state: DOWNLOADING, downloaded size: 0, reserved size: 260110, downloader id: 7618cff5-92d9-45c5-beca-fae153da5172:2338, current write offset: 0, caller id: 7618cff5-92d9-45c5-beca-fae153da5172:2338, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.093911 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp7245ab64-d827-48e6-91ef-b01b03af3986' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:09.094688 [ 2190 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpebe5c1ba-6fd4-48ed-a32d-50e01c695f43' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:09.096624 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.098494 [ 11851 ] {7618cff5-92d9-45c5-beca-fae153da5172} virtual DB::AsynchronousBoundedReadBuffer::~AsynchronousBoundedReadBuffer(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.95 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/xmu/bgycjlpnyvlvadinzmpeogtkgtuab, hash key: 37ffc437ced95bca4220163a4fb8abbf, file_offset_of_buffer_end: 0, read_until_position: 17727, internal buffer end: 17727, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 7618cff5-92d9-45c5-beca-fae153da5172:4392, file segment info: File segment: [0, 17726], key: 37ffc437ced95bca4220163a4fb8abbf, state: DOWNLOADING, downloaded size: 0, reserved size: 17727, downloader id: 7618cff5-92d9-45c5-beca-fae153da5172:4392, current write offset: 0, caller id: 7618cff5-92d9-45c5-beca-fae153da5172:4392, kind: Regular, unbound: 0. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./src/Common/Stopwatch.h:57: std::__packaged_task_func (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'(), std::allocator (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunner(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::'lambda'()>, DB::IAsynchronousReader::Result ()>::operator()() @ 0x000000002d93b38c in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task::operator()() @ 0x000000002d935538 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 22. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 23. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.099886 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.146020 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpfc3a69e4-80e4-476e-a172-6ce56c6dac5c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:09.159593 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.160491 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc8c2a8e2-4f5f-43c9-a9e8-352cfdeb6769' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:09.192907 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.209789 [ 11851 ] {7618cff5-92d9-45c5-beca-fae153da5172} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.96 GiB (attempt to allocate chunk of 1285849 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ResolutionWidth): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker::__call_impl const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034448e97 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034443992 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x0000000034443033 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:88: DB::MergeTreeReaderWide::prefetchBeginOfRange(Priority) @ 0x0000000034442934 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: std::__packaged_task_func>> (DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)> DB::threadPoolCallbackRunner>, DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, Priority) const::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::operator()(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::'lambda'(), std::allocator>> (DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)> DB::threadPoolCallbackRunner>, DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, Priority) const::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::operator()(DB::MergeTreePrefetchedReadPool::createPrefetchedReader(DB::IMergeTreeDataPart const&, DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, Priority) const::$_0&&, Priority)::'lambda'()>, std::unique_ptr> ()>::operator()() @ 0x0000000035d527ee in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task> ()>::operator()() @ 0x0000000035d5bfcc in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? 2024.10.22 00:33:09.211164 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp2dd5d47a-c620-4e68-8a4b-2384537965cf' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:09.337143 [ 2192 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.337287 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.338261 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.419431 [ 2198 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp933dabc0-907a-45ca-9d2e-7ba538aa234f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:09.421977 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.440783 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 5093957 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.448172 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp866f0092-943e-4cb3-bab3-258583e8afab' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:09.459425 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp246c91f6-aeb6-49ea-b7ab-9b3c81fffd51' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:09.460288 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.460607 [ 2004 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.461353 [ 1979 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.461425 [ 1999 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.462297 [ 2093 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.462375 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.470852 [ 1984 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.487734 [ 2085 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.490198 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp1eac4b7c-4f60-42e9-b988-a6d29df74807' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:09.494275 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.619595 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp110c9204-5860-4e21-a3fc-cd0507c2743e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:09.628136 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp60e0b3d9-74c7-4b61-8adc-8096a391fc15' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:09.645312 [ 11891 ] {345bda16-82f0-45c2-a524-53c2dedf1ce6} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048895 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:41918) (comment: 01107_atomic_db_detach_attach.sh) (in query: INSERT INTO test_01107.mt SELECT number + sleepEachRow(1) FROM numbers(5)), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f2711e3 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 2024.10.22 00:33:09.645999 [ 14378 ] {fcd337bb-d9f9-4b16-b066-e99991136439} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38040) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:09.646719 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.647048 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.647915 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.657950 [ 14378 ] {fcd337bb-d9f9-4b16-b066-e99991136439} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:09.762474 [ 11891 ] {345bda16-82f0-45c2-a524-53c2dedf1ce6} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048895 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f2711e3 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 2024.10.22 00:33:09.834559 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe2961827-dd3c-4e15-8f48-84cb76ca4f6e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:09.841882 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.844984 [ 2195 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp28ab71e0-4ac9-4b37-8888-5ec573f28173' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:09.850255 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.962310 [ 11325 ] {34e34935-14bf-4edb-af41-dcdbd4701640} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1703999 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing Remote. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38058) (comment: 00146_aggregate_function_uniq.sql) (in query: SELECT RegionID, uniqHLL12(WatchID) AS X FROM remote('127.0.0.{1,2}', test, hits) GROUP BY RegionID HAVING X > 100000 ORDER BY RegionID ASC;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:0: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x0000000034bfaee7 in /usr/bin/clickhouse 12. ./build_docker/./src/Client/Connection.cpp:435: DB::Connection::getServerRevision(DB::ConnectionTimeouts const&) @ 0x0000000034c03b91 in /usr/bin/clickhouse 13. ./build_docker/./src/Client/ConnectionEstablisher.cpp:0: DB::ConnectionEstablisher::run(PoolWithFailoverBase::TryResult&, String&) @ 0x0000000034c51f12 in /usr/bin/clickhouse 14. ./build_docker/./src/Client/ConnectionEstablisher.cpp:129: DB::ConnectionEstablisherAsync::Task::run(std::function, std::function) @ 0x0000000034c55da2 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x000000002edcf826 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: boost::context::detail::fiber_capture_record>::run() @ 0x000000002edcec1f in /usr/bin/clickhouse 17. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func>>(unsigned int, unsigned int) @ 0x000000002edcc7d4 in /usr/bin/clickhouse 2024.10.22 00:33:09.973598 [ 2191 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.974479 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:09.987833 [ 11325 ] {34e34935-14bf-4edb-af41-dcdbd4701640} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.98 GiB (attempt to allocate chunk of 1703999 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing Remote. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:0: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x0000000034bfaee7 in /usr/bin/clickhouse 12. ./build_docker/./src/Client/Connection.cpp:435: DB::Connection::getServerRevision(DB::ConnectionTimeouts const&) @ 0x0000000034c03b91 in /usr/bin/clickhouse 13. ./build_docker/./src/Client/ConnectionEstablisher.cpp:0: DB::ConnectionEstablisher::run(PoolWithFailoverBase::TryResult&, String&) @ 0x0000000034c51f12 in /usr/bin/clickhouse 14. ./build_docker/./src/Client/ConnectionEstablisher.cpp:129: DB::ConnectionEstablisherAsync::Task::run(std::function, std::function) @ 0x0000000034c55da2 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x000000002edcf826 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: boost::context::detail::fiber_capture_record>::run() @ 0x000000002edcec1f in /usr/bin/clickhouse 17. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func>>(unsigned int, unsigned int) @ 0x000000002edcc7d4 in /usr/bin/clickhouse 2024.10.22 00:33:10.048666 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp984f75b7-014e-4337-b32c-6af8a1d4d2da' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:10.051006 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.146678 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp0bd8a091-9e35-4769-9e4d-81d88bb9eb6f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:10.161275 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.214731 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp320f201b-7aed-4688-be8e-e6b53293e558' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:10.217488 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.234215 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp45278ad7-32e8-4849-bd8e-64c3ac6e2ec2' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:10.239573 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.259185 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpbfeb227f-2a72-430d-ae1f-55266ef97ac4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:10.317408 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.349681 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp4ddbe713-3979-4f90-954e-33e35787e267' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:10.357077 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.357922 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpdb5fad7d-30da-4990-8ae5-94e3e11fd634' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:10.367726 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.511755 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp96e3ad47-2f92-4858-8b17-12fb4a4885c7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:10.531189 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpf23fe4e0-478a-494d-9834-776e3c3ed404' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:10.541168 [ 2241 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 16.00 GiB (attempt to allocate chunk of 4261154 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c726b9 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c701a6 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.541350 [ 2097 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.541558 [ 2014 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.541606 [ 2089 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.541412 [ 2012 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.542118 [ 2052 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.541770 [ 2045 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.544064 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.545329 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.597105 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp3a542524-adcf-4c60-864d-9941de6f3380' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:10.599483 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp26dccc5a-bcae-41d0-bf96-f6e76f0bfd4d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:10.643978 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.643968 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.779487 [ 2198 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.784776 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp77f382b8-3016-4509-a27c-4f69455393ba' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:10.784842 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.801472 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.802898 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp601e3d39-bbe2-4d05-b996-ed7ee64986e4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:10.815486 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 16.00 GiB (attempt to allocate chunk of 4491813 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.817214 [ 2195 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp8e42450c-cd4e-45f6-9862-45bb2cf3310e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:10.823938 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.99 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.848694 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 16.00 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:10.935936 [ 11325 ] {0f2eb9cc-dddc-47d7-87bb-142be915c350} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38084) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:10.949800 [ 11325 ] {0f2eb9cc-dddc-47d7-87bb-142be915c350} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:10.951878 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 16.00 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.089154 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp06d73ee0-0c5c-471b-9816-5d1219ae9480' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:11.095475 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.190056 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp52da3fec-fdf9-490d-abdd-99ef9474a618' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:11.195893 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.198260 [ 2193 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp9f07c5a9-4175-4a72-83c8-6fa0d77c9dd7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:11.217714 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.236194 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp638f194c-49ce-4f8e-bc97-c441567cfdd1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:11.239586 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.240897 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 5164865 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.248687 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp4478dcbd-86f0-4fb1-ad01-5c066e828b18' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:11.251021 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.284351 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp6f0cc687-0341-4e88-bab5-35afcd11a981' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:11.290659 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.364720 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpebacb2ec-ae54-4d07-bd1c-50f1bb9f707a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:11.366927 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.419737 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp5e1e5cb0-d4e2-4f61-9d4a-1d12a3b8ef64' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:11.629819 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp59b11067-7468-42cc-87e8-5c579716ee53' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:11.639046 [ 11891 ] {bf073426-cf2a-4f6a-9d58-887a780eb04b} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1052735 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38108) (comment: 01318_long_unsuccessful_mutation_zookeeper.sh) (in query: CREATE TABLE mutation_table (`key` UInt64, `value` String) ENGINE = ReplicatedMergeTree('/clickhouse/tables/01318_long_unsuccessful_mutation_zookeeper_test_9/mutation_table', '1') PARTITION BY key % 10 ORDER BY key SETTINGS index_granularity = 22505, min_bytes_for_wide_part = 0, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 11372, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 75, min_merge_bytes_to_use_direct_io = 1363036969, index_granularity_bytes = 25881781, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 49830, primary_key_compress_block_size = 47051), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:33:11.639382 [ 2031 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.639678 [ 2054 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.639967 [ 2023 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.640214 [ 2090 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.640206 [ 2048 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.639764 [ 2107 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.640723 [ 11886 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.641019 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.641249 [ 2194 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.642370 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.642627 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.642877 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.643336 [ 11891 ] {bf073426-cf2a-4f6a-9d58-887a780eb04b} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1052735 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:33:11.703593 [ 14378 ] {47983dfa-b2b9-4ffc-9ebc-a2d2042e4039} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38070) (comment: 00148_monotonic_functions_and_index.sql) (in query: SELECT count() FROM test.hits WHERE -CounterID = -1731;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:11.714659 [ 14378 ] {47983dfa-b2b9-4ffc-9ebc-a2d2042e4039} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:11.739587 [ 2198 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpd267c10e-3c05-4e09-b0ea-5acf34defa99' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:11.741844 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc6808a67-bbcd-4194-af56-c7cd3561aa81' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:11.743675 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.744440 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.764631 [ 2194 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.768013 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.777890 [ 2190 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp989c01ab-a6e2-4df2-aa5d-8047b0708627' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:11.785272 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.837552 [ 11886 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.924403 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpde9742e0-a3b4-441b-9f50-d06999424973' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:11.928632 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:11.931043 [ 14378 ] {8887fd57-cf99-4d1f-9ed9-2bce2b564641} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38130) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:11.934203 [ 14378 ] {8887fd57-cf99-4d1f-9ed9-2bce2b564641} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:11.967824 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc9ca7f2b-a64b-4bc5-bf54-c59e56b9e65e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:11.991884 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.82 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.079407 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc9d3d7fd-356b-4ed8-8e58-218cc60149da' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.085718 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.100461 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp0c59b2cf-8580-4d5e-9bd2-f79f57f5e55e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.115618 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.116634 [ 11891 ] {e1db3dce-a95f-47fa-84c0-de235834d702} executeQuery: Code: 60. DB::Exception: Table test_9.mutation_table does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38142) (comment: 01318_long_unsuccessful_mutation_zookeeper.sh) (in query: INSERT INTO mutation_table select number, toString(number) from numbers(100000) where number % 10 != 0), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:12.131009 [ 11891 ] {e1db3dce-a95f-47fa-84c0-de235834d702} TCPHandler: Code: 60. DB::Exception: Table test_9.mutation_table does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:12.140595 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpef185b6d-9902-4781-bcc8-da2a23bd55fb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.142218 [ 2192 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.143168 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.147272 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.154850 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp8e5450eb-ddc4-474d-bfea-6170fadeea41' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.157440 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.419242 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp82c4306b-bc2c-4246-b5b2-5985bcc8772e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.431698 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.447528 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp545b0343-3d9f-428d-90d7-8b09f4d6cc01' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.454041 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.491048 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp1e0ad984-2bd7-4444-8c57-d8345bec8cdf' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.495243 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.497662 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp0c04efae-20f3-4204-9d3a-eb3e0ffa8750' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.502150 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.584671 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp20aea388-4af6-4d1f-af47-3326025fc88b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.585185 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp452e187f-371e-465d-bc56-d1a9cb8156f1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.589887 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.589862 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.641680 [ 2059 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.642103 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp0620528e-752b-4911-9976-98e15a77fee3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.642249 [ 1977 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.642636 [ 2040 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.643068 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb2b46395-3009-4892-bb9e-22aea53596e9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.644350 [ 1975 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.644532 [ 2006 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.644746 [ 1990 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.645889 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.646981 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.678080 [ 2189 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.687651 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.710544 [ 14378 ] {a5447ac9-e0ef-46ad-b30f-98d1eac69a1f} executeQuery: Code: 60. DB::Exception: Table test_9.mutation_table does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38162) (comment: 01318_long_unsuccessful_mutation_zookeeper.sh) (in query: INSERT INTO mutation_table VALUES), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:12.748130 [ 14378 ] {a5447ac9-e0ef-46ad-b30f-98d1eac69a1f} TCPHandler: Code: 60. DB::Exception: Table test_9.mutation_table does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:12.787288 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp539c14f2-357d-412f-9f96-03e157d52231' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.789837 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.84 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.813414 [ 2193 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp36a92170-e389-4b60-9c30-5f66dea2169f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.819738 [ 2611 ] {7a24aa1c-da9e-4b7b-a846-50d26904b57c} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38176) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:12.820109 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.84 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.824405 [ 2611 ] {7a24aa1c-da9e-4b7b-a846-50d26904b57c} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:12.867364 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp6179fde7-def5-45ba-8daa-a367548d68c6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.869691 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.895389 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.896353 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmpac8284c7-c232-4fc4-a7f8-f7169d2e9d82' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.899874 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:12.956466 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp711a1a87-23f4-4346-a437-c7095bed17bd' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:12.971310 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.83 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.080289 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp05c4b55b-f685-4cb2-be77-7541fa488fe9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:13.085552 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.092583 [ 2190 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.094826 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.130848 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpce6f9fd0-2b9a-44c9-9594-a08529378d27' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:13.141248 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.171049 [ 11891 ] {ae98d6ff-f066-4547-8eeb-d5602daf1269} executeQuery: Code: 60. DB::Exception: Table test_9.mutation_table does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38186) (comment: 01318_long_unsuccessful_mutation_zookeeper.sh) (in query: SELECT COUNT() FROM mutation_table), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:13.179471 [ 11891 ] {ae98d6ff-f066-4547-8eeb-d5602daf1269} TCPHandler: Code: 60. DB::Exception: Table test_9.mutation_table does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:13.250448 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb82f8c86-e6a4-4f23-9a98-b0a9d23253ba' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:13.608968 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.609205 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 4916465 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c53899 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.609310 [ 14378 ] {11b23aed-63ed-408a-8e79-425eadc4d3cc} executeQuery: Code: 48. DB::Exception: Conversion between numeric types and UUID is not supported. Probably the passed UUID is unquoted: While processing toUUID(-1.1). (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38184) (comment: 01634_uuid_fuzz.sql) (in query: SELECT toUUID(-1.1);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [97]) @ 0x000000000be1b6e9 in /usr/bin/clickhouse 3. COW::immutable_ptr DB::ConvertImpl, DB::DataTypeUUID, DB::NameToUUID, DB::ConvertDefaultBehaviorTag>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c5d637e in /usr/bin/clickhouse 4. bool DB::callOnIndexAndDataType>>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c5b9a1c in /usr/bin/clickhouse 5. DB::FunctionConvert>>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c5b4746 in /usr/bin/clickhouse 6. DB::FunctionConvert>>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c5b240a in /usr/bin/clickhouse 7. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 13. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 2024.10.22 00:33:13.611512 [ 2191 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.611908 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.612466 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.613953 [ 14378 ] {11b23aed-63ed-408a-8e79-425eadc4d3cc} TCPHandler: Code: 48. DB::Exception: Conversion between numeric types and UUID is not supported. Probably the passed UUID is unquoted: While processing toUUID(-1.1). (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [97]) @ 0x000000000be1b6e9 in /usr/bin/clickhouse 3. COW::immutable_ptr DB::ConvertImpl, DB::DataTypeUUID, DB::NameToUUID, DB::ConvertDefaultBehaviorTag>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000c5d637e in /usr/bin/clickhouse 4. bool DB::callOnIndexAndDataType>>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c5b9a1c in /usr/bin/clickhouse 5. DB::FunctionConvert>>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c5b4746 in /usr/bin/clickhouse 6. DB::FunctionConvert>>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c5b240a in /usr/bin/clickhouse 7. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 13. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 2024.10.22 00:33:13.667299 [ 2088 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.667966 [ 2055 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.667787 [ 1994 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.668205 [ 2013 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.668325 [ 2060 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.668214 [ 1982 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.668885 [ 11891 ] {d9c32c26-5696-4d69-9502-18ec43935cac} executeQuery: Code: 60. DB::Exception: Could not find table: mutation_table. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38210) (comment: 01318_long_unsuccessful_mutation_zookeeper.sh) (in query: ALTER TABLE mutation_table MODIFY COLUMN value UInt64 SETTINGS replication_alter_partitions_sync=0), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:13.684808 [ 2186 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp4c4ee82b-7f7e-4f39-9cf1-a6b735a2c308' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:13.694177 [ 11891 ] {d9c32c26-5696-4d69-9502-18ec43935cac} TCPHandler: Code: 60. DB::Exception: Could not find table: mutation_table. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:13.697543 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.762541 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd6e60cb1-380a-4e80-91b6-41006870a6dc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:13.800133 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.801299 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp3ad887c8-4736-44ad-8000-2893a2e4bdee' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:13.804544 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.825293 [ 2196 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.826561 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:13.910723 [ 2611 ] {c92cb5ac-423f-4cbe-8e36-06cec76050f0} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38238) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:13.931287 [ 2611 ] {c92cb5ac-423f-4cbe-8e36-06cec76050f0} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:14.008147 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpa8c25f0c-bba1-4c4e-baab-a41b424a1be8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:14.018477 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.038157 [ 2191 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpafc21200-b480-449c-b63a-2340220fe869' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:14.048391 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.049418 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc90d3120-ab39-4c6b-95d9-0a4e4418618e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:14.063905 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.064487 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp9f96b976-e76d-4b6e-85f7-9f4c4c862341' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:14.068513 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.108632 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpfa4a96a2-e20a-486f-98dd-78c1cefaf04d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:14.111887 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.126732 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp71341693-284f-4efd-af02-b88eda7f41a0' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:14.140917 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.260276 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp461d0496-6d23-4051-8204-5f176d6d3de4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:14.262247 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.358417 [ 2191 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.360341 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.372706 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp3aec4755-2ccc-4e60-a380-b72bb313412a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:14.375797 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.442831 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp227394ee-6fd5-4cb0-8442-47895ff55fc7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:14.460765 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpdc7abada-85d3-4684-99e9-221eb2a2ed8d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:14.573521 [ 11851 ] {050dd443-d70c-4aeb-8ec7-0ec72e93dea0} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38248) (comment: 00940_max_parts_in_total.sql) (in query: CREATE TABLE max_parts_in_total (`x` UInt64) ENGINE = MergeTree PARTITION BY x ORDER BY x SETTINGS max_parts_in_total = 10, index_granularity = 33039, min_bytes_for_wide_part = 571164756, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 21522, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 1, index_granularity_bytes = 24928116, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 11254, primary_key_compress_block_size = 67199), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:33:14.574123 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.574851 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.577195 [ 11851 ] {050dd443-d70c-4aeb-8ec7-0ec72e93dea0} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:33:14.580987 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.601491 [ 2195 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp8ef81dde-7efa-45bb-bbd4-32bb0d5ea220' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:14.616902 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.634121 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp907d9ef1-e550-4cde-9702-2e3f97b6bf5c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:14.634548 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe3fb04d0-d361-4015-ac12-1f5bb2c3c8e6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:14.662696 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.664023 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.679371 [ 2056 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.679784 [ 2058 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.679968 [ 2102 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.680413 [ 2105 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.681872 [ 2056 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.682352 [ 2001 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.768634 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp9cddc2af-346d-4515-a635-aceab8a2da60' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:14.769402 [ 2189 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.770860 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.772022 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.847447 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 4270682 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.885236 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp9eac3d51-a704-41dd-892d-c5eb572ee10b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:14.888846 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.73 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.969144 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 4630337 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.973579 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 4512293 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:14.982539 [ 14378 ] {0afc32de-ad61-42e6-85d5-e760de357610} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38266) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:14.996465 [ 14378 ] {0afc32de-ad61-42e6-85d5-e760de357610} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:15.023265 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmpe92603ef-553f-4131-9e78-7c32b439ceb4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.027181 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.138616 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpbbdc5b12-6ec8-4eae-ba1f-5cef7b4ddfb0' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.160240 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.206347 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp1815dc44-6778-457c-870c-b49ce1c947f7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.209109 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.216613 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp19c192ad-b113-4ae5-a39f-2b1ef1c578e5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.218850 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.246706 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpbab45ff0-f54a-4767-8e6f-5fd996bb0117' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.249747 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.254567 [ 2187 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.256982 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.257999 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp034fb957-3a56-4c11-ac67-812efd58d547' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.267879 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.329733 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp30d77542-4bd3-4fed-8f41-1c5b4751d8c8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.329877 [ 2241 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 5072865 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c726b9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.335248 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp113cde01-6a55-4972-b9bc-567c69656d74' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.338975 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.369626 [ 2199 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.372114 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.431446 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.433407 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.460937 [ 11851 ] {ae63c4b1-3332-40bd-ab82-219108f346fe} TemporaryFileOnDisk: Temporary path 'tmp985ebe04-269d-4cc6-bf32-b1e15230fa41' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.462254 [ 11851 ] {ae63c4b1-3332-40bd-ab82-219108f346fe} GraceHashJoin: Can't create bucket 0 due to error: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1110579 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.537022 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 5075525 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.537126 [ 11851 ] {ae63c4b1-3332-40bd-ab82-219108f346fe} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1110579 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38278) (comment: 00098_l_union_all.sql) (in query: SELECT a,b,c,d FROM (SELECT 1 AS a,2 AS b, 3 AS c UNION ALL SELECT 2,3,4 ) js1 ANY INNER JOIN (SELECT 1 AS a,2 AS b,4 AS d UNION ALL SELECT 2,3,5) js2 USING (a) ORDER BY a,b,c,d ASC;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::TemporaryFileStream::TemporaryFileStream(std::unique_ptr>, DB::Block const&, DB::TemporaryDataOnDisk*) @ 0x0000000031e49cc4 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::TemporaryDataOnDisk::createStream(DB::Block const&, unsigned long) @ 0x0000000031e49000 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/GraceHashJoin.cpp:0: DB::GraceHashJoin::addBuckets(unsigned long) @ 0x0000000030983acf in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/GraceHashJoin.cpp:0: DB::GraceHashJoin::initBuckets() @ 0x0000000030982bad in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::GraceHashJoin::initialize(DB::Block const&) @ 0x000000003098d5b8 in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Transforms/JoiningTransform.cpp:0: DB::JoiningTransform::transformHeader(DB::Block, std::shared_ptr const&) @ 0x00000000357d2d81 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/QueryPlan/JoinStep.cpp:0: DB::JoinStep::JoinStep(DB::DataStream const&, DB::DataStream const&, std::shared_ptr, unsigned long, unsigned long, bool) @ 0x0000000035c6ded9 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x00000000315277de in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:33:15.544128 [ 11851 ] {ae63c4b1-3332-40bd-ab82-219108f346fe} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1110579 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::TemporaryFileStream::TemporaryFileStream(std::unique_ptr>, DB::Block const&, DB::TemporaryDataOnDisk*) @ 0x0000000031e49cc4 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::TemporaryDataOnDisk::createStream(DB::Block const&, unsigned long) @ 0x0000000031e49000 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/GraceHashJoin.cpp:0: DB::GraceHashJoin::addBuckets(unsigned long) @ 0x0000000030983acf in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/GraceHashJoin.cpp:0: DB::GraceHashJoin::initBuckets() @ 0x0000000030982bad in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::GraceHashJoin::initialize(DB::Block const&) @ 0x000000003098d5b8 in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Transforms/JoiningTransform.cpp:0: DB::JoiningTransform::transformHeader(DB::Block, std::shared_ptr const&) @ 0x00000000357d2d81 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/QueryPlan/JoinStep.cpp:0: DB::JoinStep::JoinStep(DB::DataStream const&, DB::DataStream const&, std::shared_ptr, unsigned long, unsigned long, bool) @ 0x0000000035c6ded9 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x00000000315277de in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:33:15.616559 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpaffbeb93-13ab-407a-83ec-6a1f2761b851' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.625379 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.642276 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp25c3f500-2a3a-4b71-8377-a4fdc300210c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.677025 [ 2187 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp0661d9a0-b2e5-4579-a4ac-96091a0b5d9f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.677348 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.681117 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.681705 [ 2047 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.682343 [ 2007 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.682710 [ 2010 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.683590 [ 1985 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.684722 [ 2077 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.686804 [ 2010 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.718111 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp0358da21-9bcc-4ff2-b47f-2f76f3fb2545' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.725633 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.727555 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp50af6939-5e47-43b7-8d25-2df310156ba7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.731736 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.748885 [ 2194 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.750971 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.872798 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 4720161 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.924436 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmpdf100b83-f889-4052-bf6c-85205e5640c6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.924942 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpfbb1c3bc-f911-4320-8626-2962875b3720' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.932715 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.933082 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.74 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:15.999689 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp4a2efa6a-2721-46d3-95a3-a12b2d6a29be' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:15.999602 [ 14378 ] {82a666e3-4a32-49ac-b675-72cf0628f560} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38298) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:16.002617 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.005615 [ 14378 ] {82a666e3-4a32-49ac-b675-72cf0628f560} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:16.090354 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmpd47eeb09-ee7d-430a-a72e-dd34911c2dbd' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:16.093378 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.131005 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp9429bb89-ee44-4ca0-a9c5-2d9a189c66cd' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:16.134243 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpa1549d43-2294-4721-a4ed-e898bda177fd' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:16.136019 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.138184 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.161146 [ 2197 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.162264 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.174373 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp592c0867-f5b6-48b2-983d-7b5eb60eba11' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:16.245416 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd49963cf-74bc-4c2c-9c4e-dfd997afcb92' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:16.248492 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.248873 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.277475 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.301730 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpcd6b8df6-d0e5-4d9b-ac0d-4c8232addde7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:16.352509 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.76 GiB (attempt to allocate chunk of 5164865 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.428565 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.431424 [ 2197 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp38d5e605-9902-45fe-b300-fd1dfc690c73' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:16.442097 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.464759 [ 2184 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.467726 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.563029 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 4197490 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.567217 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpd1591075-33af-40b9-be47-e861d4ce5e77' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:16.569396 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.624166 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 4904985 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c53899 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.722497 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp95f6098b-4a05-4d95-8b79-43212a8dd379' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:16.754774 [ 2004 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.755030 [ 2066 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.754850 [ 2030 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.755517 [ 2085 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.755220 [ 2305 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryViewsLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 5176641 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c914d9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.756578 [ 2026 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.794673 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.795108 [ 11325 ] {d3dd4150-bf87-4ffc-9306-0a5d62e4c657} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_1_7_1/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38152) (comment: 00037_uniq_state_merge1.sql) (in query: SELECT k, any(u) AS u, uniqMerge(us) AS us FROM (SELECT domain(URL) AS k, uniq(UserID) AS u, uniqState(UserID) AS us FROM test.hits GROUP BY k) GROUP BY k ORDER BY u DESC, k ASC LIMIT 100 ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 2024.10.22 00:33:16.803165 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd229cc89-127b-412b-aa82-4d24ff8f7783' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:16.806377 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.806461 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.812321 [ 11325 ] {d3dd4150-bf87-4ffc-9306-0a5d62e4c657} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_1_7_1/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 2024.10.22 00:33:16.813230 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 4219201 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.840980 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp38de01d7-1f82-4e6a-a60b-10568479e3a7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:16.851741 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.854155 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb0e333ca-4393-432d-ace7-e72c3f6bd74f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:16.855831 [ 2082 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.865003 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.918462 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp774132a2-dd13-4381-91fa-1f891d951e9f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:16.919307 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp2eabd169-a1a0-4039-8aa0-825f54125333' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:16.923492 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.927430 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.951105 [ 2196 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.964620 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.969892 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp5ceb7705-39a3-409f-b127-a97682652f53' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:16.971075 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp1b6c11b2-c246-4c2b-b178-eef1de3c53b1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:16.973316 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:16.987390 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.75 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:17.066630 [ 2611 ] {d67d7a13-2e22-4d38-be1b-f9b40978c630} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38352) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:17.078449 [ 2611 ] {d67d7a13-2e22-4d38-be1b-f9b40978c630} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:17.393598 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp9f9f85c8-1467-4e06-b8af-0332abeb5cf6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:17.393742 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp62e15e68-3e55-4cfa-8242-d54cad5dc970' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:17.421410 [ 2190 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpa635c708-9c4e-4121-85ff-6a39464efaed' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:17.563378 [ 2307 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 4446950 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ca0bd9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c9e6c6 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d966779 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:17.938546 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:17.938721 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:17.938957 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:17.939374 [ 2035 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:17.939552 [ 1993 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:17.939681 [ 2072 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:17.939724 [ 2012 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:17.940106 [ 2097 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:17.940481 [ 14378 ] {c06c67ff-5298-44a0-865a-d23b7d95cc58} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1052208 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While processing wkt(polygonsSymDifferenceSpherical([[(29.453587685533865, 59.779570356240356), (29.393139070478895, 52.276266797422124), (40.636581470703206, 59.38168915000267), (41.21084331372543, 59.103467777099866), (29.786055068336193, 52.146627480315004), (31.23682182965546, 52.16517054781818), (41.69443223416517, 58.85424941916091), (42.51048853740727, 58.47703162291134), (32.59691566839227, 52.22075341251539), (34.289476889931414, 52.22075341251539), (43.02430176537451, 58.07974369546071), (43.02430176537451, 57.25537683364851), (35.468224883503325, 52.2022335126388), (37.16078610504247, 52.23926559241349), (43.02430176537451, 56.26136189644947), (43.02430176537451, 55.326904361850836), (38.33953409861437, 52.16517054781818), (40.09254393520848, 52.16517054781818), (44.4146199116388, 55.3097062225408), (44.47506852669377, 59.80998197603594), (39.72985224487867, 59.931351417569715), (30.23941968124846, 53.67744677450975), (30.20919537372098, 54.63314259659509), (38.73245009647167, 59.94649146557819), (37.2816833351524, 59.97675082987618), (30.23941968124846, 55.2752875586599), (30.33009260383092, 56.19415599955667), (36.28428118674541, 59.96162460231375), (34.863738732953635, 59.97675082987618), (30.178971066193498, 56.97640788219866), (30.178971066193498, 57.91957806959033), (33.65476643185424, 59.94649146557819), (32.32489690064491, 59.94649146557819), (30.481214141468342, 58.85424941916091), (30.571887064050795, 59.99187015036608), (29.453587685533865, 59.779570356240356)]], [[[(33.473420586689336, 58.85424941916091), (32.23422397806246, 58.492830557036), (32.173775363007486, 58.03176922751564), (31.508840597402823, 57.499784781503735), (31.750635057622702, 56.86092686957355), (31.508840597402823, 55.941082594334574), (32.20399967053497, 55.515591939372456), (31.84130798020516, 54.998862226280465), (31.418167674820367, 54.422670886434275), (32.47601843828233, 53.83826377018255), (32.08310244042503, 53.408048308050866), (33.171177511414484, 52.82758702113742), (34.77306581037117, 52.91880107773494), (34.77306581037117, 53.784726518357985), (34.108131044766516, 54.17574726780569), (35.07530888564602, 54.59813930694554), (34.25925258240394, 54.96417435716029), (35.01486027059106, 55.361278263643584), (33.50364489421682, 55.37845402950552), (32.7480372060297, 55.90721384574556), (35.67979503619571, 55.68634475630185), (32.83871012861215, 56.311688992608396), (34.591719965206266, 56.29492065473883), (35.7100193437232, 56.311688992608396), (33.83611227701915, 56.695333481003644), (32.95960735872209, 56.9434497616887), (36.072711034053015, 57.091531913901434), (33.171177511414484, 57.33702717078384), (36.193608264162954, 57.499784781503735), (33.23162612646945, 57.77481561306047), (36.43540272438284, 58.04776787540811), (33.62454212432676, 58.27099811968307), (36.344729801800376, 58.54018474404165), (33.83611227701915, 58.68186423448108), (34.74284150284369, 59.565911441555244), (33.473420586689336, 58.85424941916091)]], [[(34.65216858026123, 58.91672306881671), (37.19101041256995, 58.68186423448108), (36.01226241899805, 58.28688958537609), (37.16078610504247, 58.04776787540811), (35.74024365125068, 57.79092907387934), (37.009664567405046, 57.499784781503735), (35.77046795877817, 57.25537683364851), (36.979440259877556, 57.07510745541089), (34.22902827487645, 56.794777197297435), (36.7074214921302, 56.210968525786996), (34.712617195316206, 56.10998276812964), (36.55629995449277, 55.63519693782703), (35.13575750070099, 55.53270067649592), (36.43540272438284, 55.34409504165558), (34.83351442542614, 55.01619492319591), (35.61934642114075, 54.49294870011772), (34.89396304048112, 54.12264226523038), (35.37755196092087, 53.046178687628185), (37.43280487278982, 52.95523300597458), (35.92158949641559, 53.80257986695776), (36.91899164482259, 53.856094327816805), (36.01226241899805, 54.75541714463799), (37.765272255592166, 55.189110239786885), (36.828318722240134, 55.44708256557195), (38.03729102333953, 55.652253637168315), (36.64697287707522, 55.941082594334574), (38.21863686850443, 56.05939028508024), (36.37495410932787, 56.64551287174558), (38.30930979108689, 56.992876013526654), (37.16078610504247, 57.25537683364851), (38.127963945921984, 57.516020773674256), (37.43280487278982, 57.710289827306724), (38.33953409861437, 57.935626886818994), (37.40258056526235, 58.31865112960426), (38.58132855883426, 58.744648733419496), (37.31190764267989, 59.02578062465136), (34.65216858026123, 58.91672306881671)]], [[(38.52087994377928, 59.11898412389468), (39.54850639971376, 58.713270635642914), (38.369758406141855, 58.28688958537609), (38.85334732658162, 58.06375936407028), (38.33953409861437, 57.710289827306724), (38.73245009647167, 57.48354156434209), (38.21863686850443, 57.271721400459285), (38.97424455669155, 56.87744603722649), (37.463029180317314, 56.5623320541159), (38.94402024916407, 56.05939028508024), (38.18841256097694, 55.856355210835915), (38.490655636251795, 55.53270067649592), (37.795496563119656, 55.39562234093384), (38.30930979108689, 55.154587013355666), (36.7074214921302, 54.65063295250911), (37.31190764267989, 53.92734063371401), (36.979440259877556, 53.58783775557231), (37.855945178174615, 52.91880107773497), (39.57873070724124, 52.69956490610895), (38.33953409861437, 53.281741738901104), (40.00187101262603, 53.35396273604752), (39.54850639971376, 53.58783775557231), (40.24366547284591, 53.58783775557231), (39.97164670509855, 53.98069568468355), (40.60635716317572, 54.03398248547225), (40.39478701048334, 54.44025165268903), (39.54850639971376, 54.56310590284329), (39.54850639971376, 54.87732350170489), (40.39478701048334, 54.87732350170489), (40.39478701048334, 55.24083903654295), (39.82052516746112, 55.2752875586599), (39.760076552406154, 55.75443792473942), (40.57613285564824, 55.78844000174894), (40.425011318010824, 56.19415599955667), (39.82052516746112, 56.07626182891758), (39.79030085993364, 56.41214455508424), (40.48545993306579, 56.495655446714636), (40.33433839542836, 56.95993246553937), (39.79030085993364, 56.992876013526654), (39.72985224487867, 57.46729112028032), (40.33433839542836, 57.46729112028032), (40.24366547284591, 58.04776787540811), (39.63917932229622, 58.04776787540811), (39.63917932229622, 58.382088724871295), (40.33433839542836, 58.382088724871295), (40.45523562553831, 58.9011152358548), (38.52087994377928, 59.11898412389468)]]])). (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38328) (comment: 01304_polygons_sym_difference.sql) (in query: select wkt(polygonsSymDifferenceSpherical([[(29.453587685533865,59.779570356240356),(29.393139070478895,52.276266797422124),(40.636581470703206,59.38168915000267),(41.21084331372543,59.103467777099866),(29.786055068336193,52.146627480315004),(31.23682182965546,52.16517054781818),(41.69443223416517,58.85424941916091),(42.51048853740727,58.47703162291134),(32.59691566839227,52.22075341251539),(34.289476889931414,52.22075341251539),(43.02430176537451,58.07974369546071),(43.02430176537451,57.25537683364851),(35.468224883503325,52.2022335126388),(37.16078610504247,52.23926559241349),(43.02430176537451,56.26136189644947),(43.02430176537451,55.326904361850836),(38.33953409861437,52.16517054781818),(40.09254393520848,52.16517054781818),(44.4146199116388,55.3097062225408),(44.47506852669377,59.80998197603594),(39.72985224487867,59.931351417569715),(30.23941968124846,53.67744677450975),(30.20919537372098,54.63314259659509),(38.73245009647167,59.94649146557819),(37.2816833351524,59.97675082987618),(30.23941968124846,55.2752875586599),(30.33009260383092,56.19415599955667),(36.28428118674541,59.96162460231375),(34.863738732953635,59.97675082987618),(30.178971066193498,56.97640788219866),(30.178971066193498,57.91957806959033),(33.65476643185424,59.94649146557819),(32.32489690064491,59.94649146557819),(30.481214141468342,58.85424941916091),(30.571887064050795,59.99187015036608),(29.453587685533865,59.779570356240356)]], [[[(33.473420586689336,58.85424941916091),(32.23422397806246,58.492830557036),(32.173775363007486,58.03176922751564),(31.508840597402823,57.499784781503735),(31.750635057622702,56.86092686957355),(31.508840597402823,55.941082594334574),(32.20399967053497,55.515591939372456),(31.84130798020516,54.998862226280465),(31.418167674820367,54.422670886434275),(32.47601843828233,53.83826377018255),(32.08310244042503,53.408048308050866),(33.171177511414484,52.82758702113742),(34.77306581037117,52.91880107773494),(34.77306581037117,53.784726518357985),(34.108131044766516,54.17574726780569),(35.07530888564602,54.59813930694554),(34.25925258240394,54.96417435716029),(35.01486027059106,55.361278263643584),(33.50364489421682,55.37845402950552),(32.7480372060297,55.90721384574556),(35.67979503619571,55.68634475630185),(32.83871012861215,56.311688992608396),(34.591719965206266,56.29492065473883),(35.7100193437232,56.311688992608396),(33.83611227701915,56.695333481003644),(32.95960735872209,56.9434497616887),(36.072711034053015,57.091531913901434),(33.171177511414484,57.33702717078384),(36.193608264162954,57.499784781503735),(33.23162612646945,57.77481561306047),(36.43540272438284,58.04776787540811),(33.62454212432676,58.27099811968307),(36.344729801800376,58.54018474404165),(33.83611227701915,58.68186423448108),(34.74284150284369,59.565911441555244),(33.473420586689336,58.85424941916091)]], [[(34.65216858026123,58.91672306881671),(37.19101041256995,58.68186423448108),(36.01226241899805,58.28688958537609),(37.16078610504247,58.04776787540811),(35.74024365125068,57.79092907387934),(37.009664567405046,57.499784781503735),(35.77046795877817,57.25537683364851),(36.979440259877556,57.07510745541089),(34.22902827487645,56.794777197297435),(36.7074214921302,56.210968525786996),(34.712617195316206,56.10998276812964),(36.55629995449277,55.63519693782703),(35.13575750070099,55.53270067649592),(36.43540272438284,55.34409504165558),(34.83351442542614,55.01619492319591),(35.61934642114075,54.49294870011772),(34.89396304048112,54.12264226523038),(35.37755196092087,53.046178687628185),(37.43280487278982,52.95523300597458),(35.92158949641559,53.80257986695776),(36.91899164482259,53.856094327816805),(36.01226241899805,54.75541714463799),(37.765272255592166,55.189110239786885),(36.828318722240134,55.44708256557195),(38.03729102333953,55.652253637168315),(36.64697287707522,55.941082594334574),(38.21863686850443,56.05939028508024),(36.37495410932787,56.64551287174558),(38.30930979108689,56.992876013526654),(37.16078610504247,57.25537683364851),(38.127963945921984,57.516020773674256),(37.43280487278982,57.710289827306724),(38.33953409861437,57.935626886818994),(37.40258056526235,58.31865112960426),(38.58132855883426,58.744648733419496),(37.31190764267989,59.02578062465136),(34.65216858026123,58.91672306881671)]], [[(38.52087994377928,59.11898412389468),(39.54850639971376,58.713270635642914),(38.369758406141855,58.28688958537609),(38.85334732658162,58.06375936407028),(38.33953409861437,57.710289827306724),(38.73245009647167,57.48354156434209),(38.21863686850443,57.271721400459285),(38.97424455669155,56.87744603722649),(37.463029180317314,56.5623320541159),(38.94402024916407,56.05939028508024),(38.18841256097694,55.856355210835915),(38.490655636251795,55.53270067649592),(37.795496563119656,55.39562234093384),(38.30930979108689,55.154587013355666),(36.7074214921302,54.65063295250911),(37.31190764267989,53.92734063371401),(36.979440259877556,53.58783775557231),(37.855945178174615,52.91880107773497),(39.57873070724124,52.69956490610895),(38.33953409861437,53.281741738901104),(40.00187101262603,53.35396273604752),(39.54850639971376,53.58783775557231),(40.24366547284591,53.58783775557231),(39.97164670509855,53.98069568468355),(40.60635716317572,54.03398248547225),(40.39478701048334,54.44025165268903),(39.54850639971376,54.56310590284329),(39.54850639971376,54.87732350170489),(40.39478701048334,54.87732350170489),(40.39478701048334,55.24083903654295),(39.82052516746112,55.2752875586599),(39.760076552406154,55.75443792473942),(40.57613285564824,55.78844000174894),(40.425011318010824,56.19415599955667),(39.82052516746112,56.07626182891758),(39.79030085993364,56.41214455508424),(40.48545993306579,56.495655446714636),(40.33433839542836,56.95993246553937),(39.79030085993364,56.992876013526654),(39.72985224487867,57.46729112028032),(40.33433839542836,57.46729112028032),(40.24366547284591,58.04776787540811),(39.63917932229622,58.04776787540811),(39.63917932229622,58.382088724871295),(40.33433839542836,58.382088724871295),(40.45523562553831,58.9011152358548),(38.52087994377928,59.11898412389468)]]])) format Null;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::reserveForNextSize<>() @ 0x000000000bdcc744 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:0: DB::ColumnVector::insert(DB::Field const&) @ 0x000000003289bf8e in /usr/bin/clickhouse 11. ./build_docker/./src/Columns/ColumnTuple.cpp:146: DB::ColumnTuple::insert(DB::Field const&) @ 0x0000000032755b0e in /usr/bin/clickhouse 12. ./build_docker/./src/Common/COW.h:284: DB::IDataType::createColumnConst(unsigned long, DB::Field const&) const @ 0x000000002f095577 in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsMatcher::visit(DB::ASTLiteral const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd38972 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd27eec in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd27eec in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd27eec in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd27eec in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd27eec in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 2024.10.22 00:33:17.941225 [ 2104 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:17.947068 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:17.962866 [ 14378 ] {c06c67ff-5298-44a0-865a-d23b7d95cc58} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1052208 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While processing wkt(polygonsSymDifferenceSpherical([[(29.453587685533865, 59.779570356240356), (29.393139070478895, 52.276266797422124), (40.636581470703206, 59.38168915000267), (41.21084331372543, 59.103467777099866), (29.786055068336193, 52.146627480315004), (31.23682182965546, 52.16517054781818), (41.69443223416517, 58.85424941916091), (42.51048853740727, 58.47703162291134), (32.59691566839227, 52.22075341251539), (34.289476889931414, 52.22075341251539), (43.02430176537451, 58.07974369546071), (43.02430176537451, 57.25537683364851), (35.468224883503325, 52.2022335126388), (37.16078610504247, 52.23926559241349), (43.02430176537451, 56.26136189644947), (43.02430176537451, 55.326904361850836), (38.33953409861437, 52.16517054781818), (40.09254393520848, 52.16517054781818), (44.4146199116388, 55.3097062225408), (44.47506852669377, 59.80998197603594), (39.72985224487867, 59.931351417569715), (30.23941968124846, 53.67744677450975), (30.20919537372098, 54.63314259659509), (38.73245009647167, 59.94649146557819), (37.2816833351524, 59.97675082987618), (30.23941968124846, 55.2752875586599), (30.33009260383092, 56.19415599955667), (36.28428118674541, 59.96162460231375), (34.863738732953635, 59.97675082987618), (30.178971066193498, 56.97640788219866), (30.178971066193498, 57.91957806959033), (33.65476643185424, 59.94649146557819), (32.32489690064491, 59.94649146557819), (30.481214141468342, 58.85424941916091), (30.571887064050795, 59.99187015036608), (29.453587685533865, 59.779570356240356)]], [[[(33.473420586689336, 58.85424941916091), (32.23422397806246, 58.492830557036), (32.173775363007486, 58.03176922751564), (31.508840597402823, 57.499784781503735), (31.750635057622702, 56.86092686957355), (31.508840597402823, 55.941082594334574), (32.20399967053497, 55.515591939372456), (31.84130798020516, 54.998862226280465), (31.418167674820367, 54.422670886434275), (32.47601843828233, 53.83826377018255), (32.08310244042503, 53.408048308050866), (33.171177511414484, 52.82758702113742), (34.77306581037117, 52.91880107773494), (34.77306581037117, 53.784726518357985), (34.108131044766516, 54.17574726780569), (35.07530888564602, 54.59813930694554), (34.25925258240394, 54.96417435716029), (35.01486027059106, 55.361278263643584), (33.50364489421682, 55.37845402950552), (32.7480372060297, 55.90721384574556), (35.67979503619571, 55.68634475630185), (32.83871012861215, 56.311688992608396), (34.591719965206266, 56.29492065473883), (35.7100193437232, 56.311688992608396), (33.83611227701915, 56.695333481003644), (32.95960735872209, 56.9434497616887), (36.072711034053015, 57.091531913901434), (33.171177511414484, 57.33702717078384), (36.193608264162954, 57.499784781503735), (33.23162612646945, 57.77481561306047), (36.43540272438284, 58.04776787540811), (33.62454212432676, 58.27099811968307), (36.344729801800376, 58.54018474404165), (33.83611227701915, 58.68186423448108), (34.74284150284369, 59.565911441555244), (33.473420586689336, 58.85424941916091)]], [[(34.65216858026123, 58.91672306881671), (37.19101041256995, 58.68186423448108), (36.01226241899805, 58.28688958537609), (37.16078610504247, 58.04776787540811), (35.74024365125068, 57.79092907387934), (37.009664567405046, 57.499784781503735), (35.77046795877817, 57.25537683364851), (36.979440259877556, 57.07510745541089), (34.22902827487645, 56.794777197297435), (36.7074214921302, 56.210968525786996), (34.712617195316206, 56.10998276812964), (36.55629995449277, 55.63519693782703), (35.13575750070099, 55.53270067649592), (36.43540272438284, 55.34409504165558), (34.83351442542614, 55.01619492319591), (35.61934642114075, 54.49294870011772), (34.89396304048112, 54.12264226523038), (35.37755196092087, 53.046178687628185), (37.43280487278982, 52.95523300597458), (35.92158949641559, 53.80257986695776), (36.91899164482259, 53.856094327816805), (36.01226241899805, 54.75541714463799), (37.765272255592166, 55.189110239786885), (36.828318722240134, 55.44708256557195), (38.03729102333953, 55.652253637168315), (36.64697287707522, 55.941082594334574), (38.21863686850443, 56.05939028508024), (36.37495410932787, 56.64551287174558), (38.30930979108689, 56.992876013526654), (37.16078610504247, 57.25537683364851), (38.127963945921984, 57.516020773674256), (37.43280487278982, 57.710289827306724), (38.33953409861437, 57.935626886818994), (37.40258056526235, 58.31865112960426), (38.58132855883426, 58.744648733419496), (37.31190764267989, 59.02578062465136), (34.65216858026123, 58.91672306881671)]], [[(38.52087994377928, 59.11898412389468), (39.54850639971376, 58.713270635642914), (38.369758406141855, 58.28688958537609), (38.85334732658162, 58.06375936407028), (38.33953409861437, 57.710289827306724), (38.73245009647167, 57.48354156434209), (38.21863686850443, 57.271721400459285), (38.97424455669155, 56.87744603722649), (37.463029180317314, 56.5623320541159), (38.94402024916407, 56.05939028508024), (38.18841256097694, 55.856355210835915), (38.490655636251795, 55.53270067649592), (37.795496563119656, 55.39562234093384), (38.30930979108689, 55.154587013355666), (36.7074214921302, 54.65063295250911), (37.31190764267989, 53.92734063371401), (36.979440259877556, 53.58783775557231), (37.855945178174615, 52.91880107773497), (39.57873070724124, 52.69956490610895), (38.33953409861437, 53.281741738901104), (40.00187101262603, 53.35396273604752), (39.54850639971376, 53.58783775557231), (40.24366547284591, 53.58783775557231), (39.97164670509855, 53.98069568468355), (40.60635716317572, 54.03398248547225), (40.39478701048334, 54.44025165268903), (39.54850639971376, 54.56310590284329), (39.54850639971376, 54.87732350170489), (40.39478701048334, 54.87732350170489), (40.39478701048334, 55.24083903654295), (39.82052516746112, 55.2752875586599), (39.760076552406154, 55.75443792473942), (40.57613285564824, 55.78844000174894), (40.425011318010824, 56.19415599955667), (39.82052516746112, 56.07626182891758), (39.79030085993364, 56.41214455508424), (40.48545993306579, 56.495655446714636), (40.33433839542836, 56.95993246553937), (39.79030085993364, 56.992876013526654), (39.72985224487867, 57.46729112028032), (40.33433839542836, 57.46729112028032), (40.24366547284591, 58.04776787540811), (39.63917932229622, 58.04776787540811), (39.63917932229622, 58.382088724871295), (40.33433839542836, 58.382088724871295), (40.45523562553831, 58.9011152358548), (38.52087994377928, 59.11898412389468)]]])). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::reserveForNextSize<>() @ 0x000000000bdcc744 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:0: DB::ColumnVector::insert(DB::Field const&) @ 0x000000003289bf8e in /usr/bin/clickhouse 11. ./build_docker/./src/Columns/ColumnTuple.cpp:146: DB::ColumnTuple::insert(DB::Field const&) @ 0x0000000032755b0e in /usr/bin/clickhouse 12. ./build_docker/./src/Common/COW.h:284: DB::IDataType::createColumnConst(unsigned long, DB::Field const&) const @ 0x000000002f095577 in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsMatcher::visit(DB::ASTLiteral const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd38972 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd27eec in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd27eec in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd27eec in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd27eec in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd27eec in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 2024.10.22 00:33:17.977265 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmpe8346149-2b30-42fe-8063-c749e196a56f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:17.999351 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.060537 [ 2197 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.065591 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.080764 [ 11843 ] {7e4c4c5f-fe10-4c6b-9801-2f0e3c0c2ab6} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38394) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:18.088547 [ 11843 ] {7e4c4c5f-fe10-4c6b-9801-2f0e3c0c2ab6} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:18.092362 [ 11851 ] {6ac6a3ae-3775-415d-8ec2-d36c50ffd746} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38360) (comment: 00097_constexpr_in_index.sql) (in query: -- Even in presense of OR, we evaluate the "0 IN (1, 2, 3)" as a constant expression therefore it does not prevent the index analysis. SELECT count() FROM test.hits WHERE CounterID IN (14917930, 33034174) OR 0 IN (1, 2, 3) SETTINGS max_rows_to_read = 1000000, force_primary_key = 1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:18.094195 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp05e87cc2-349e-4dda-928b-12c5017c8ab3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:18.105182 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.106816 [ 11851 ] {6ac6a3ae-3775-415d-8ec2-d36c50ffd746} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:18.242236 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7f7d3d78-d722-4661-b4f4-f27d7cb83409' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:18.243415 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp4ae5a032-75c4-42d7-82c3-8949b465aeaa' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:18.245572 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.248032 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.288338 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp47ad234a-5ffe-4819-9bd8-2b76906990ff' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:18.292549 [ 11891 ] {562a8bc8-663b-401f-bcc6-a18b90cfe5d2} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1051228 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: test/gyx/rorffhurwkkgujqleazwkcviynhzz, hash key: 1768b72ab4c319f9ba6d6dffdb952222, file_offset_of_buffer_end: 0, read_until_position: 222, internal buffer end: 222, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 562a8bc8-663b-401f-bcc6-a18b90cfe5d2:2380, file segment info: File segment: [0, 221], key: 1768b72ab4c319f9ba6d6dffdb952222, state: DOWNLOADING, downloaded size: 0, reserved size: 222, downloader id: 562a8bc8-663b-401f-bcc6-a18b90cfe5d2:2380, current write offset: 0, caller id: 562a8bc8-663b-401f-bcc6-a18b90cfe5d2:2380, kind: Regular, unbound: 0: While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38260) (comment: 02765_queries_with_subqueries_profile_events.sh) (in query: SELECT 1 view, 0 allow_experimental_analyzer, ProfileEvents['InsertQuery'] InsertQuery, ProfileEvents['SelectQuery'] SelectQuery, ProfileEvents['InsertQueriesWithSubqueries'] InsertQueriesWithSubqueries, -- FIXME: for analyzer it will have one more for sample block ProfileEvents['SelectQueriesWithSubqueries'] SelectQueriesWithSubqueries, ProfileEvents['QueriesWithSubqueries'] QueriesWithSubqueries FROM system.query_log WHERE current_database = currentDatabase() AND type = 'QueryFinish' AND query_id = 'vhquatqtlu' FORMAT TSVWithNames;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 5. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 17. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec784a9 in /usr/bin/clickhouse 18. ./build_docker/./src/IO/ReadBuffer.h:72: DB::MergeTreeMarksLoader::loadMarksImpl() @ 0x00000000343aece8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::MergeTreeMarksLoader::loadMarks() @ 0x00000000343ac8a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/threadPoolCallbackRunner.h:43: std::__packaged_task_func> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'(), std::allocator> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'()>, std::shared_ptr ()>::operator()() @ 0x00000000343b2cba in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task ()>::operator()() @ 0x00000000343b7f6c in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:18.294215 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.309533 [ 2199 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.311266 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.324846 [ 11891 ] {562a8bc8-663b-401f-bcc6-a18b90cfe5d2} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1051228 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: test/gyx/rorffhurwkkgujqleazwkcviynhzz, hash key: 1768b72ab4c319f9ba6d6dffdb952222, file_offset_of_buffer_end: 0, read_until_position: 222, internal buffer end: 222, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 562a8bc8-663b-401f-bcc6-a18b90cfe5d2:2380, file segment info: File segment: [0, 221], key: 1768b72ab4c319f9ba6d6dffdb952222, state: DOWNLOADING, downloaded size: 0, reserved size: 222, downloader id: 562a8bc8-663b-401f-bcc6-a18b90cfe5d2:2380, current write offset: 0, caller id: 562a8bc8-663b-401f-bcc6-a18b90cfe5d2:2380, kind: Regular, unbound: 0: While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 5. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 17. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec784a9 in /usr/bin/clickhouse 18. ./build_docker/./src/IO/ReadBuffer.h:72: DB::MergeTreeMarksLoader::loadMarksImpl() @ 0x00000000343aece8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::MergeTreeMarksLoader::loadMarks() @ 0x00000000343ac8a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/threadPoolCallbackRunner.h:43: std::__packaged_task_func> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'(), std::allocator> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'()>, std::shared_ptr ()>::operator()() @ 0x00000000343b2cba in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task ()>::operator()() @ 0x00000000343b7f6c in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:18.458032 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc88c4144-543f-4ee3-bb0d-286e0b34c017' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:18.472725 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.505825 [ 2193 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp0fc124b6-73f9-4192-b828-2ae56f65436c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:18.511240 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.515731 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb20f2779-e02c-42ed-aa05-78646d1c2703' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:18.619938 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.731491 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp216247b7-6ffc-4771-8863-2a0720fe35bc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:18.748134 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.796121 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpeec66492-e3b5-437d-bcae-efd4cce1040d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:18.799832 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.811322 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpa68eb610-a830-440c-ae7c-46613d27ba8e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:18.836280 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.853285 [ 2185 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.855405 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.875589 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpcd9f8d1c-01b4-47b7-8e52-5437ab8a6884' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:18.878768 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.944038 [ 2106 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.944702 [ 2069 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.944860 [ 2032 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.945575 [ 2054 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.946142 [ 2023 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:18.946647 [ 2090 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.076472 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc9ca537e-dff4-4be5-980a-bdb03be7fe8d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:19.078897 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.205243 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp9ffa0741-e69d-4cd2-88e6-620f52e1cc98' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:19.208924 [ 11850 ] {2e6f3b5a-76f0-4e43-a51e-e01fa7dd0111} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38460) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:19.209016 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.210391 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb36bffa6-5cd9-4741-835f-cb58a31867e6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:19.212336 [ 11850 ] {2e6f3b5a-76f0-4e43-a51e-e01fa7dd0111} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:19.321999 [ 2198 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.330000 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.346095 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.356934 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.407916 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpda642aab-e3a4-4002-91c1-425c660b64f5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:19.409945 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp084fd663-5b46-4bb3-9aaa-c322deeb83e0' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:19.416275 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.417490 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.427326 [ 2199 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpdef88e0f-83ca-4272-9259-42f8e7477479' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:19.429823 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.441432 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp135d8843-d9da-4066-b111-2e1d42abf798' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:19.444811 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.463659 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp241fb760-b7c1-45ad-876b-aa2414d67519' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:19.465828 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.502366 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpa5a8a01e-ab1a-464e-94ae-60d79bfaf13a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:19.505822 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.608655 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp6ab29fef-151c-4299-9bc9-c11d7e7d5cb4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:19.611898 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.753972 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp626daf5d-4929-464d-b7a8-913013fd5e20' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:19.755613 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe11ca8c8-decc-412e-8316-142dfe937404' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:19.781073 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.783480 [ 2611 ] {6607018f-487d-4e93-ad89-64f335f2bacd} executeQuery: Code: 48. DB::Exception: MergeJoinAlgorithm is not implemented for strictness RightAny. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38428) (comment: 00074_full_join.sql) (in query: SELECT CounterID, hits, visits FROM ( SELECT (CounterID % 100000) AS CounterID, count() AS hits FROM test.hits GROUP BY CounterID ) ANY FULL OUTER JOIN ( SELECT (CounterID % 100000) AS CounterID, sum(Sign) AS visits FROM test.visits GROUP BY CounterID HAVING visits > 0 ) USING CounterID WHERE hits = 0 OR visits = 0 ORDER BY hits + visits * 10 DESC, CounterID ASC LIMIT 20;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type>, DB::JoinStrictness&) @ 0x000000003580b0fb in /usr/bin/clickhouse 3. ./build_docker/./src/Processors/Transforms/MergeJoinTransform.cpp:294: DB::MergeJoinAlgorithm::MergeJoinAlgorithm(std::shared_ptr, std::vector> const&, unsigned long) @ 0x00000000357f61f6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Merges/IMergingTransform.h:159: DB::MergeJoinTransform::MergeJoinTransform(std::shared_ptr, std::vector> const&, DB::Block const&, unsigned long, unsigned long) @ 0x00000000358085e9 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::QueryPipelineBuilder::joinPipelinesYShaped(std::unique_ptr>, std::unique_ptr>, std::shared_ptr, DB::Block const&, unsigned long, std::vector, std::allocator>>*) @ 0x000000002ed7ce37 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/QueryPlan/JoinStep.cpp:41: DB::JoinStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x0000000035c6f104 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x0000000035c9ad33 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e6039 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:19.795300 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.800495 [ 2611 ] {6607018f-487d-4e93-ad89-64f335f2bacd} TCPHandler: Code: 48. DB::Exception: MergeJoinAlgorithm is not implemented for strictness RightAny. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type>, DB::JoinStrictness&) @ 0x000000003580b0fb in /usr/bin/clickhouse 3. ./build_docker/./src/Processors/Transforms/MergeJoinTransform.cpp:294: DB::MergeJoinAlgorithm::MergeJoinAlgorithm(std::shared_ptr, std::vector> const&, unsigned long) @ 0x00000000357f61f6 in /usr/bin/clickhouse 4. ./build_docker/./src/Processors/Merges/IMergingTransform.h:159: DB::MergeJoinTransform::MergeJoinTransform(std::shared_ptr, std::vector> const&, DB::Block const&, unsigned long, unsigned long) @ 0x00000000358085e9 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::QueryPipelineBuilder::joinPipelinesYShaped(std::unique_ptr>, std::unique_ptr>, std::shared_ptr, DB::Block const&, unsigned long, std::vector, std::allocator>>*) @ 0x000000002ed7ce37 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/QueryPlan/JoinStep.cpp:41: DB::JoinStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x0000000035c6f104 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x0000000035c9ad33 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e6039 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:19.849406 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe1e10c32-2ff7-498d-9532-edcdddbdb243' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:19.852168 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.857000 [ 2193 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.858975 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.869963 [ 2241 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 5013217 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c726b9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.927426 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 4525125 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.934251 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp22893dd4-a4b5-452d-9861-07bcdb6a6d20' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:19.937240 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.946201 [ 2091 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.946494 [ 2100 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.947588 [ 2086 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.947976 [ 2059 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.948392 [ 2019 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:19.948739 [ 1977 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.068466 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 4512293 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.207727 [ 2194 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.208736 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.211433 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp60e9c77a-70d3-49c8-b49f-623af1f74e63' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.213471 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.217902 [ 2611 ] {2959a794-b4ab-4735-a3e5-e2c3709504c6} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:33940) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:20.220318 [ 2611 ] {2959a794-b4ab-4735-a3e5-e2c3709504c6} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:20.256355 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 4506145 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.300175 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpfaba2064-5b79-4e84-aaf9-49d295d0f6fb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.302435 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.378057 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp47bc2536-fcc0-4e54-a91c-41768342b817' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.393239 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd733c076-3a77-41b2-9b71-a9e214332c05' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.395429 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.409318 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.412954 [ 2196 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpa1487df3-9914-4186-ae13-3f076809dfd5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.524301 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.544847 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp93c8f55c-afee-462a-aefc-e80ffebccf6f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.547905 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc31d170d-c9be-41ca-997c-5d847749c4ec' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.548761 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.550030 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.568098 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc71a5384-430d-49db-9b54-f6933d28ad47' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.571335 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.578739 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp8d74e988-6973-47a7-9459-c6f258122842' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.581950 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.640782 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp6e2f091b-c9e5-4227-ae85-34250f60516a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.642838 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.648256 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.650525 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp3bd1e898-cedf-4692-bad6-cc3e896b3a74' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.659757 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.685979 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp88eb9894-996f-4656-a992-8d785665fe85' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.691675 [ 2189 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.699388 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.700356 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.714688 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpab2cbc36-6d03-4797-90d0-2f1016900418' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.718268 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.775048 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpcd57f726-4f98-42bd-b78f-99705dd0270f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.806366 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp30cc3f49-991e-4ddc-93d0-cb9e8116a80b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.887941 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.888022 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.916473 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp3f9070f5-1c35-4a7f-9ed2-34e37e57ac97' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.932896 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.935179 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpbae19cf8-0af0-4f31-b780-9450840e462b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.940566 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.947921 [ 2034 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.948758 [ 2044 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.959553 [ 2032 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.959208 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpb0ee4026-92d1-4ba6-8706-51892e583af2' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.960215 [ 2023 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.967354 [ 2054 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.967615 [ 2069 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:20.976205 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb1e2866d-bace-4d7d-8182-822f1ef78dcf' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:20.981144 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.062940 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 5164865 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.065239 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.48 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.073861 [ 11851 ] {c30bdbfb-e4cc-4dd3-8969-085c3d3429d5} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:33958) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:21.081082 [ 11851 ] {c30bdbfb-e4cc-4dd3-8969-085c3d3429d5} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:21.093709 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp25b9eb73-5d76-4def-8b93-45f61091aec6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:21.094170 [ 2199 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.105704 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.107059 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.124506 [ 2195 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp41318466-7c97-4a31-94c5-ad7203203d94' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:21.132155 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpebe8c531-a64a-4cda-865d-f18729357e75' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:21.136592 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.140131 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.149032 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.202325 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 4220522 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.275993 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp5560d923-cbe9-4d52-b28a-6acc66e9bff3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:21.281311 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.284257 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc1d7d5fd-a4f2-4332-8143-3b5b810f3f42' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:21.295436 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.296085 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 4889321 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c53899 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.343613 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp367dac22-e437-451c-a51c-252503fe3f66' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:21.346361 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.438487 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp4106fe18-7cab-4dd2-a87e-0dfed74865fb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:21.443555 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.465831 [ 2199 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.468759 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.484380 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp4759fc58-628b-4eda-85df-8791383e6cfb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:21.487099 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.488003 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 4224833 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.624568 [ 2611 ] {b19160f2-34fc-4d63-9bc6-1f5e2775caa1} executeQuery: Code: 60. DB::Exception: Could not find table: mutation_table. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:33984) (comment: 01318_long_unsuccessful_mutation_zookeeper.sh) (in query: ALTER TABLE mutation_table MODIFY COLUMN value UInt32 SETTINGS replication_alter_partitions_sync=0), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:21.625133 [ 2191 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp9260574a-513f-4c81-9125-8f545292ceb1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:21.640118 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpaa605cb9-b9ac-40d3-9981-78f76a2d5c5f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:21.892354 [ 2307 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 4194337 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 7. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::reserveForNextSize<>() @ 0x000000000bdcc599 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/PODArray.h:0: DB::ReverseIndex::insert(StringRef) @ 0x000000002ee53047 in /usr/bin/clickhouse 9. ./build_docker/./src/Columns/ColumnUnique.h:0: COW::mutable_ptr DB::ColumnUnique::uniqueInsertRangeImpl(DB::IColumn const&, unsigned long, unsigned long, unsigned long, DB::ColumnVector::MutablePtr&&, DB::ReverseIndex*, unsigned long) @ 0x000000002ee4b30e in /usr/bin/clickhouse 10. ./build_docker/./src/Columns/ColumnUnique.h:589: DB::ColumnUnique::uniqueInsertRangeFrom(DB::IColumn const&, unsigned long, unsigned long) @ 0x000000002ee44f91 in /usr/bin/clickhouse 11. ./build_docker/./src/Columns/ColumnLowCardinality.cpp:0: DB::ColumnLowCardinality::Dictionary::compact(DB::IColumnUnique const&, COW::mutable_ptr&) @ 0x0000000032633fd6 in /usr/bin/clickhouse 12. ./build_docker/./src/Columns/ColumnLowCardinality.cpp:0: DB::ColumnLowCardinality::cutAndCompact(unsigned long, unsigned long) const @ 0x00000000326338c0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::SerializationLowCardinality::serializeBinaryBulkWithMultipleStreams(DB::IColumn const&, unsigned long, unsigned long, DB::ISerialization::SerializeBinaryBulkSettings&, std::shared_ptr&) const @ 0x000000002f1cbe1c in /usr/bin/clickhouse 14. ./build_docker/./src/DataTypes/Serializations/SerializationNamed.cpp:0: DB::SerializationNamed::serializeBinaryBulkWithMultipleStreams(DB::IColumn const&, unsigned long, unsigned long, DB::ISerialization::SerializeBinaryBulkSettings&, std::shared_ptr&) const @ 0x000000002f1eb718 in /usr/bin/clickhouse 15. ./build_docker/./src/DataTypes/Serializations/SerializationTuple.cpp:0: DB::SerializationTuple::serializeBinaryBulkWithMultipleStreams(DB::IColumn const&, unsigned long, unsigned long, DB::ISerialization::SerializeBinaryBulkSettings&, std::shared_ptr&) const @ 0x000000002f2973f0 in /usr/bin/clickhouse 16. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::serializeBinaryBulkWithMultipleStreams(DB::IColumn const&, unsigned long, unsigned long, DB::ISerialization::SerializeBinaryBulkSettings&, std::shared_ptr&) const @ 0x000000002f160836 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector> const&) @ 0x000000003415ef05 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:186: DB::MergeTreeDataPartWriterCompact::writeDataBlockPrimaryIndexAndSkipIndices(DB::Block const&, std::vector> const&) @ 0x000000003415d9a0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x00000000341604a0 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:422: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&) @ 0x0000000034162472 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c2f49 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ac548 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.892514 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.892553 [ 2611 ] {b19160f2-34fc-4d63-9bc6-1f5e2775caa1} TCPHandler: Code: 60. DB::Exception: Could not find table: mutation_table. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:21.922500 [ 11850 ] {5ae34d25-2a6a-4a6c-b40e-b0b4b94147ba} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1243832 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: while executing 'FUNCTION concat('string: ' :: 2, toString(number) :: 3) -> concat('string: ', toString(number)) String : 1'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:33988) (comment: 02122_parallel_formatting_JSONCompactEachRow.sh) (in query: select number, number + 1, concat('string: ', toString(number)) from numbers(200000) format JSONCompactEachRow), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd8d085 in /usr/bin/clickhouse 10. DB::(anonymous namespace)::ConcatImpl::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000102c5c5d in /usr/bin/clickhouse 11. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:21.922533 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.923461 [ 2195 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.949410 [ 2003 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.950370 [ 2022 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.961186 [ 2082 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.964167 [ 2102 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.968978 [ 2056 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.970498 [ 2001 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.990694 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:21.994031 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.010676 [ 11850 ] {5ae34d25-2a6a-4a6c-b40e-b0b4b94147ba} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.49 GiB (attempt to allocate chunk of 1243832 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: while executing 'FUNCTION concat('string: ' :: 2, toString(number) :: 3) -> concat('string: ', toString(number)) String : 1'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd8d085 in /usr/bin/clickhouse 10. DB::(anonymous namespace)::ConcatImpl::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000102c5c5d in /usr/bin/clickhouse 11. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:22.065630 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpfe7edc68-f1be-4fb2-9a93-34e3296f59a3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.070286 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.133062 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp641c68e4-f7e4-43a6-9cea-a5f97930327d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.135401 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.158631 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7dda16f3-12cb-42b3-964e-c392f6091280' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.160764 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.177376 [ 11851 ] {fae99808-73bb-442a-bb15-1086bb22f25a} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:33998) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:22.207543 [ 11851 ] {fae99808-73bb-442a-bb15-1086bb22f25a} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:22.221301 [ 2193 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.232921 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.253455 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpf971253d-1baa-4a02-8506-8bd228d84141' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.254946 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.273498 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpec6e1abc-44ab-4995-86ed-04cf194374f5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.277472 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.292586 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp78cc23c7-f34d-4cc2-ab8c-e110a27d5add' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.296439 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.317183 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc23e0946-8db9-4030-beca-181aaed877b3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.319947 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.375780 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp36d425a5-adfa-44c6-8200-ee8b1fe08a9f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.378702 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.415668 [ 2189 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.418216 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.423772 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp05f1f9ad-630a-400c-be08-0c2439b467cf' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.423938 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp9cc55d69-a3d3-46de-b775-afa3b767e10c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.426600 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.426623 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.498346 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc545b89c-40fe-478a-b38c-c5901d7dcf6d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.503076 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.508637 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpd7d0a5a5-5821-43ab-996f-f565d6da8f35' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.510926 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.531414 [ 2193 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp079fc5f1-dfb2-43e2-99b7-5f5f50889742' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.534932 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.553348 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp76c49f4f-6a5b-4660-b3a8-6ca44564fb64' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.557320 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.660887 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.673633 [ 14378 ] {2ffe5bf8-efc4-4048-a9c4-6b39898609ac} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1051228 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: test/gyx/rorffhurwkkgujqleazwkcviynhzz, hash key: 1768b72ab4c319f9ba6d6dffdb952222, file_offset_of_buffer_end: 0, read_until_position: 222, internal buffer end: 222, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 2ffe5bf8-efc4-4048-a9c4-6b39898609ac:2380, file segment info: File segment: [0, 221], key: 1768b72ab4c319f9ba6d6dffdb952222, state: DOWNLOADING, downloaded size: 0, reserved size: 222, downloader id: 2ffe5bf8-efc4-4048-a9c4-6b39898609ac:2380, current write offset: 0, caller id: 2ffe5bf8-efc4-4048-a9c4-6b39898609ac:2380, kind: Regular, unbound: 0: While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:33922) (comment: 02765_queries_with_subqueries_profile_events.sh) (in query: SELECT 1 subquery, 0 allow_experimental_analyzer, ProfileEvents['InsertQuery'] InsertQuery, ProfileEvents['SelectQuery'] SelectQuery, ProfileEvents['InsertQueriesWithSubqueries'] InsertQueriesWithSubqueries, ProfileEvents['SelectQueriesWithSubqueries'] SelectQueriesWithSubqueries, ProfileEvents['QueriesWithSubqueries'] QueriesWithSubqueries FROM system.query_log WHERE current_database = currentDatabase() AND type = 'QueryFinish' AND query_id = 'eaumuleblf' FORMAT TSVWithNames;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 5. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 17. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec784a9 in /usr/bin/clickhouse 18. ./build_docker/./src/IO/ReadBuffer.h:72: DB::MergeTreeMarksLoader::loadMarksImpl() @ 0x00000000343aece8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::MergeTreeMarksLoader::loadMarks() @ 0x00000000343ac8a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/threadPoolCallbackRunner.h:43: std::__packaged_task_func> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'(), std::allocator> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'()>, std::shared_ptr ()>::operator()() @ 0x00000000343b2cba in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task ()>::operator()() @ 0x00000000343b7f6c in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:22.680510 [ 14378 ] {2ffe5bf8-efc4-4048-a9c4-6b39898609ac} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1051228 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: test/gyx/rorffhurwkkgujqleazwkcviynhzz, hash key: 1768b72ab4c319f9ba6d6dffdb952222, file_offset_of_buffer_end: 0, read_until_position: 222, internal buffer end: 222, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 2ffe5bf8-efc4-4048-a9c4-6b39898609ac:2380, file segment info: File segment: [0, 221], key: 1768b72ab4c319f9ba6d6dffdb952222, state: DOWNLOADING, downloaded size: 0, reserved size: 222, downloader id: 2ffe5bf8-efc4-4048-a9c4-6b39898609ac:2380, current write offset: 0, caller id: 2ffe5bf8-efc4-4048-a9c4-6b39898609ac:2380, kind: Regular, unbound: 0: While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 5. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 17. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec784a9 in /usr/bin/clickhouse 18. ./build_docker/./src/IO/ReadBuffer.h:72: DB::MergeTreeMarksLoader::loadMarksImpl() @ 0x00000000343aece8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::MergeTreeMarksLoader::loadMarks() @ 0x00000000343ac8a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/threadPoolCallbackRunner.h:43: std::__packaged_task_func> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'(), std::allocator> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'()>, std::shared_ptr ()>::operator()() @ 0x00000000343b2cba in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task ()>::operator()() @ 0x00000000343b7f6c in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:22.744347 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp57a63c0f-8c72-403e-a19d-003117b78145' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.782584 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.800062 [ 2611 ] {e3abe7da-7bc3-4d9e-a2d5-c20c0dba3ea8} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1243832 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION concat('string: ' :: 2, toString(number) :: 3) -> concat('string: ', toString(number)) String : 1'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34020) (comment: 02122_parallel_formatting_JSONCompactEachRow.sh) (in query: select number, number + 1, concat('string: ', toString(number)) from numbers(200000) format JSONCompactEachRow), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd8d085 in /usr/bin/clickhouse 10. DB::(anonymous namespace)::ConcatImpl::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000102c5c5d in /usr/bin/clickhouse 11. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:22.814114 [ 2194 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.815049 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.822913 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpaf2f7425-a20a-44b6-94fa-3d125ac377f5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.825385 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.931879 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpdddc6906-f97b-4943-8934-fbc2f2a217c6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.932858 [ 2611 ] {e3abe7da-7bc3-4d9e-a2d5-c20c0dba3ea8} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1243832 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION concat('string: ' :: 2, toString(number) :: 3) -> concat('string: ', toString(number)) String : 1'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd8d085 in /usr/bin/clickhouse 10. DB::(anonymous namespace)::ConcatImpl::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000102c5c5d in /usr/bin/clickhouse 11. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:22.934334 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:22.965902 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd84a7eac-23f4-48ca-a9ec-fecdcb5b2ce4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.978725 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpb548da3b-6bf2-475a-91b8-68d891fc42b9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:22.989737 [ 2197 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp2b46e7c7-e6cc-4860-999f-38db972c2f99' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:23.001761 [ 11851 ] {daf7dc35-3840-4f56-99b9-1ad99ad3899d} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34026) (comment: 01162_strange_mutations.sh) (in query: insert into t values ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageSet.cpp:0: DB::SetOrJoinSink::SetOrJoinSink(std::shared_ptr, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String const&, String const&, String const&, bool) @ 0x000000003355ce5e in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::SetOrJoinSink* std::construct_at[abi:v15000]&, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String&, std::__fs::filesystem::path, String, bool&, DB::SetOrJoinSink*>(DB::SetOrJoinSink*, std::shared_ptr&, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String&, std::__fs::filesystem::path&&, String&&, bool&) @ 0x000000003356c2cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::StorageSetOrJoinBase::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000033560961 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageJoin.cpp:0: DB::StorageJoin::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000032ef14ab in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Transforms/buildPushingToViewsChain.cpp:0: DB::buildPushingToViewsChain(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, bool, std::shared_ptr, std::shared_ptr, std::atomic*, bool, DB::Block const&) @ 0x000000003597e761 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:291: DB::InterpreterInsertQuery::buildSink(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::atomic*) @ 0x00000000314a79c7 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:534: DB::InterpreterInsertQuery::execute() @ 0x00000000314afcbd in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:23.006381 [ 1986 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.007014 [ 2013 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.007457 [ 1982 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.007685 [ 2092 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.008429 [ 2060 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.008527 [ 1994 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.009125 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.013462 [ 11851 ] {daf7dc35-3840-4f56-99b9-1ad99ad3899d} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageSet.cpp:0: DB::SetOrJoinSink::SetOrJoinSink(std::shared_ptr, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String const&, String const&, String const&, bool) @ 0x000000003355ce5e in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::SetOrJoinSink* std::construct_at[abi:v15000]&, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String&, std::__fs::filesystem::path, String, bool&, DB::SetOrJoinSink*>(DB::SetOrJoinSink*, std::shared_ptr&, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String&, std::__fs::filesystem::path&&, String&&, bool&) @ 0x000000003356c2cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::StorageSetOrJoinBase::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000033560961 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageJoin.cpp:0: DB::StorageJoin::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000032ef14ab in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Transforms/buildPushingToViewsChain.cpp:0: DB::buildPushingToViewsChain(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, bool, std::shared_ptr, std::shared_ptr, std::atomic*, bool, DB::Block const&) @ 0x000000003597e761 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:291: DB::InterpreterInsertQuery::buildSink(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::atomic*) @ 0x00000000314a79c7 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:534: DB::InterpreterInsertQuery::execute() @ 0x00000000314afcbd in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:23.013814 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.061665 [ 2185 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.064102 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.074479 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe7a43900-3a2d-4dab-8dcd-509d4b382ce0' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:23.096482 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.45 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.167883 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.50 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.177985 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp6512b12c-d458-453b-b458-896c2814c3ae' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:23.180347 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.187594 [ 14378 ] {41b7cbf3-b11e-4463-8d39-735c46b6938f} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34042) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:23.207221 [ 14378 ] {41b7cbf3-b11e-4463-8d39-735c46b6938f} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:23.219262 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc6361bf9-8f39-49ff-9094-29571a5ba8d6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:23.225266 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.230414 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp3edce996-17fe-4710-a5d8-8593c0302174' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:23.232860 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.261069 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.262654 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp2f2f38b4-30e3-4d8a-a334-c026c76ed1f5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:23.280067 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.283254 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp5bf7cb85-23ed-45a3-86f2-39f8c1861aad' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:23.288118 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.405239 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp77d2c14f-d54c-40f4-8c20-7e55f130f2aa' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:23.413319 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpccb6f7f1-18f8-4589-aab1-3030250ae912' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:23.821858 [ 2611 ] {80af1085-9e89-4a98-a26c-9cc594f6ef44} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1505976 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34064) (comment: 02122_parallel_formatting_JSONCompactEachRow.sh) (in query: select number, number + 1, concat('string: ', toString(number)) from numbers(200000) group by number with totals order by number limit 190000 format JSONCompactEachRow), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d53a447 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/HashTable/HashTable.h:0: HashTable, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>::resize(unsigned long, unsigned long) @ 0x00000000300b4c37 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/HashTable/HashTable.h:307: void DB::Aggregator::executeImplBatch, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>>(DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>&, DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const @ 0x00000000301cb03d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::executeImpl, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>>(DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>&, DB::Arena*, unsigned long, unsigned long, std::vector>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000002ff5e700 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeImpl(DB::AggregatedDataVariants&, unsigned long, unsigned long, std::vector>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000002fda3e8c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/Aggregator.cpp:1593: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdabf57 in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 20. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:23.821927 [ 2241 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 4972385 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c726b9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.822965 [ 2197 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.833383 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.833661 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.834289 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:23.834933 [ 2611 ] {80af1085-9e89-4a98-a26c-9cc594f6ef44} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1505976 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d53a447 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/HashTable/HashTable.h:0: HashTable, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>::resize(unsigned long, unsigned long) @ 0x00000000300b4c37 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/HashTable/HashTable.h:307: void DB::Aggregator::executeImplBatch, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>>(DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>&, DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const @ 0x00000000301cb03d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::executeImpl, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>>(DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>&, DB::Arena*, unsigned long, unsigned long, std::vector>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000002ff5e700 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeImpl(DB::AggregatedDataVariants&, unsigned long, unsigned long, std::vector>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000002fda3e8c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/Aggregator.cpp:1593: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdabf57 in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 20. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:23.939370 [ 11851 ] {e9ac2beb-cff5-4109-b0d5-6d8bd270b166} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34072) (comment: 01162_strange_mutations.sh) (in query: insert into t values ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageSet.cpp:0: DB::SetOrJoinSink::SetOrJoinSink(std::shared_ptr, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String const&, String const&, String const&, bool) @ 0x000000003355ce5e in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::SetOrJoinSink* std::construct_at[abi:v15000]&, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String&, std::__fs::filesystem::path, String, bool&, DB::SetOrJoinSink*>(DB::SetOrJoinSink*, std::shared_ptr&, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String&, std::__fs::filesystem::path&&, String&&, bool&) @ 0x000000003356c2cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::StorageSetOrJoinBase::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000033560961 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageJoin.cpp:0: DB::StorageJoin::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000032ef14ab in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Transforms/buildPushingToViewsChain.cpp:0: DB::buildPushingToViewsChain(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, bool, std::shared_ptr, std::shared_ptr, std::atomic*, bool, DB::Block const&) @ 0x000000003597e761 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:291: DB::InterpreterInsertQuery::buildSink(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::atomic*) @ 0x00000000314a79c7 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:534: DB::InterpreterInsertQuery::execute() @ 0x00000000314afcbd in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:23.941760 [ 11851 ] {e9ac2beb-cff5-4109-b0d5-6d8bd270b166} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageSet.cpp:0: DB::SetOrJoinSink::SetOrJoinSink(std::shared_ptr, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String const&, String const&, String const&, bool) @ 0x000000003355ce5e in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::SetOrJoinSink* std::construct_at[abi:v15000]&, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String&, std::__fs::filesystem::path, String, bool&, DB::SetOrJoinSink*>(DB::SetOrJoinSink*, std::shared_ptr&, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String&, std::__fs::filesystem::path&&, String&&, bool&) @ 0x000000003356c2cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::StorageSetOrJoinBase::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000033560961 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageJoin.cpp:0: DB::StorageJoin::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000032ef14ab in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Transforms/buildPushingToViewsChain.cpp:0: DB::buildPushingToViewsChain(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, bool, std::shared_ptr, std::shared_ptr, std::atomic*, bool, DB::Block const&) @ 0x000000003597e761 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:291: DB::InterpreterInsertQuery::buildSink(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::atomic*) @ 0x00000000314a79c7 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:534: DB::InterpreterInsertQuery::execute() @ 0x00000000314afcbd in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:23.994963 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp14f5fb66-94c9-42a8-9bb9-c386a41fecfe' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:24.001696 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.004041 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpdc2219a5-b2fa-49e1-997f-1533b9442eab' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:24.007561 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.008522 [ 2066 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.009166 [ 2004 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.009365 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.46 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.009861 [ 2026 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.010467 [ 2099 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.010657 [ 2066 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.013751 [ 2105 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.031400 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp5ec873b4-e176-479c-9a58-66108f1d34d4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:24.036777 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp8ea4c02c-64af-4792-9c03-2090846d18c0' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:24.037382 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.038470 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.039827 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4526149 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.082155 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp16ab1cff-f1a4-4d4c-be47-fefa6da0af47' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:24.085600 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.088189 [ 1911 ] {c33fb624-4044-48e4-af44-d9a0bbdc5a64} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34086) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:24.090968 [ 1911 ] {c33fb624-4044-48e4-af44-d9a0bbdc5a64} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:24.151281 [ 2190 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp383da6fa-b15c-4400-b385-f8d3fb339987' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:24.154938 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.166204 [ 2192 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.167562 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.202721 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp6054da47-650c-4ea4-a8b4-3075053ccbff' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:24.217386 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.258267 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp09d6b643-8a51-4c4d-a7de-c377ba8d657f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:24.276142 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp37debbbc-2798-49a7-af0d-5c5fbf6d1b35' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:24.496086 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4486311 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 7. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/PODArray.h:321: DB::ColumnString::insert(DB::Field const&) @ 0x00000000326f278b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/TextLog.cpp:71: DB::TextLogElement::appendToBlock(std::vector::mutable_ptr, std::allocator::mutable_ptr>>&) const @ 0x0000000031e5e471 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cedaac in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031ceb946 in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d96ae39 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.497233 [ 11843 ] {b0c8b414-eb68-4929-8e15-e171853694ef} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1457799 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/84f/84f788e2-4f4e-45fa-bf6b-97219cb78fa2/201403_8_8_0/ in table test.visits (84f788e2-4f4e-45fa-bf6b-97219cb78fa2) located on disk s3_disk of type s3, from mark 31 with max_rows_to_read = 3392): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:33944) (comment: 00024_random_counters.sql) (in query: SELECT uniq(UserID), sum(Sign) FROM test.visits WHERE CounterID = 32152608;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:100: std::unique_ptr> std::__function::__policy_invoker> ()>::__call_impl> ()>>(std::__function::__policy_storage const*) @ 0x0000000034440309 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: non-virtual thunk to DB::CachedCompressedReadBuffer::setReadUntilPosition(unsigned long) @ 0x0000000034431645 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 2024.10.22 00:33:24.497409 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.497286 [ 2188 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.497670 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.498867 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.514020 [ 11843 ] {b0c8b414-eb68-4929-8e15-e171853694ef} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1457799 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/84f/84f788e2-4f4e-45fa-bf6b-97219cb78fa2/201403_8_8_0/ in table test.visits (84f788e2-4f4e-45fa-bf6b-97219cb78fa2) located on disk s3_disk of type s3, from mark 31 with max_rows_to_read = 3392): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:100: std::unique_ptr> std::__function::__policy_invoker> ()>::__call_impl> ()>>(std::__function::__policy_storage const*) @ 0x0000000034440309 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: non-virtual thunk to DB::CachedCompressedReadBuffer::setReadUntilPosition(unsigned long) @ 0x0000000034431645 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 2024.10.22 00:33:24.544252 [ 11851 ] {bab545b1-461e-4a7c-9b06-af4fc9846a15} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34092) (comment: 02122_parallel_formatting_JSONCompactEachRow.sh) (in query: select number, number + 1, concat('string: ', toString(number)) from numbers(200000) group by number with totals order by number limit 190000 format JSONCompactEachRow), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:24.546446 [ 11851 ] {bab545b1-461e-4a7c-9b06-af4fc9846a15} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:24.575764 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp35f56925-1ed4-4f11-9cf5-91ccf273d068' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:24.584311 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.587628 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp9473929b-03cc-4a8f-b9b8-eb106ee20e6e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:24.643943 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.687973 [ 2195 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpaa5c62df-bfac-4454-b494-ab9bbfc2f621' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:24.689246 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.690489 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.698737 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpaf235807-3eae-4052-b9c1-b904ecff402d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:24.709848 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.832811 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpd613ea8f-b42c-4b05-9639-a1df13ca6b76' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:24.837958 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.849235 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp3dfae177-f078-46f2-972e-f14f6de16685' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:24.858252 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:24.916237 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp3277ad17-5635-4d6a-ac2e-c435bef8780f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:25.035522 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe97a04cd-c724-48c4-b847-fe9c2030deb7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:25.213314 [ 2487 ] {9b8f9e16-5110-4a5c-bb66-b5a6cf88b024} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34132) (comment: 01162_strange_mutations.sh) (in query: alter table t delete where n global in (select * from (select * from t where n global in (1::Int32)))), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageJoin.cpp:0: DB::StorageJoin::mutate(DB::MutationCommands const&, std::shared_ptr) @ 0x0000000032ef3fa2 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112be20 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 21. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:25.213503 [ 2047 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.213521 [ 2027 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.213744 [ 1985 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.214273 [ 2077 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.214334 [ 2010 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.214544 [ 2016 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.215283 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.215038 [ 2193 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.215575 [ 11424 ] {0beaff4a-2ef7-4390-93ea-61f9275ed4df} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34166) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:25.216219 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.216811 [ 2487 ] {9b8f9e16-5110-4a5c-bb66-b5a6cf88b024} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageJoin.cpp:0: DB::StorageJoin::mutate(DB::MutationCommands const&, std::shared_ptr) @ 0x0000000032ef3fa2 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:0: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112be20 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 21. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 25. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:25.216552 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.231192 [ 11424 ] {0beaff4a-2ef7-4390-93ea-61f9275ed4df} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:25.257555 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp86ade773-901e-420a-9fbe-ed17e414eac6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:25.269513 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.279488 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp324678a8-4bbf-4c7a-9e91-a6c6f06bdd30' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:25.353829 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.387215 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp2705b178-231c-4a30-98eb-0375a76ae808' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:25.528135 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.528887 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.529648 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp09af4b86-21ea-4ecb-a066-2556ab3db6c0' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:25.539447 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.685617 [ 2184 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpd014dba8-86dc-4ae6-ba4f-2119ed48d626' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:25.688986 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.691016 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 5164865 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.697939 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmpd0f31d37-201b-4d38-80dc-3edfc7dba9bc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:25.713311 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp99c45749-c0fe-45c5-b2d7-9efdff0d035e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:25.717650 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.750002 [ 2190 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.751487 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.758244 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4220522 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.800348 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.851073 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpa49499a8-afe4-47b0-8442-9f886afd8ff1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:25.851295 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4886521 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c53899 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.851103 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp6ddbff44-f6b8-4c43-bc70-e4258abaaf02' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:25.916626 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.920335 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:25.933209 [ 11851 ] {265db01e-0383-40da-82c4-11b67641470d} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1179711 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34146) (comment: 00065_loyalty_with_storage_join.sql) (in query: INSERT INTO join SELECT UserID, toInt8(if((sum(SearchEngineID = 2) AS yandex) > (sum(SearchEngineID = 3) AS google), yandex / (yandex + google), -google / (yandex + google)) * 10) AS loyalty FROM hits WHERE (SearchEngineID = 2) OR (SearchEngineID = 3) GROUP BY UserID HAVING (yandex + google) > 10;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageSet.cpp:0: DB::SetOrJoinSink::SetOrJoinSink(std::shared_ptr, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String const&, String const&, String const&, bool) @ 0x000000003355ce5e in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::SetOrJoinSink* std::construct_at[abi:v15000]&, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String&, std::__fs::filesystem::path, String, bool&, DB::SetOrJoinSink*>(DB::SetOrJoinSink*, std::shared_ptr&, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String&, std::__fs::filesystem::path&&, String&&, bool&) @ 0x000000003356c2cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::StorageSetOrJoinBase::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000033560961 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageJoin.cpp:0: DB::StorageJoin::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000032ef14ab in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Transforms/buildPushingToViewsChain.cpp:0: DB::buildPushingToViewsChain(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, bool, std::shared_ptr, std::shared_ptr, std::atomic*, bool, DB::Block const&) @ 0x000000003597e761 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:291: DB::InterpreterInsertQuery::buildSink(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::atomic*) @ 0x00000000314a79c7 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:534: DB::InterpreterInsertQuery::execute() @ 0x00000000314afcbd in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:26.035996 [ 11851 ] {265db01e-0383-40da-82c4-11b67641470d} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1179711 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&>(std::__fs::filesystem::path&&, unsigned long&, int&, std::shared_ptr const&) @ 0x000000002f48ac63 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/DiskLocal.cpp:0: DB::DiskLocal::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f46e2be in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/StorageSet.cpp:0: DB::SetOrJoinSink::SetOrJoinSink(std::shared_ptr, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String const&, String const&, String const&, bool) @ 0x000000003355ce5e in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::SetOrJoinSink* std::construct_at[abi:v15000]&, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String&, std::__fs::filesystem::path, String, bool&, DB::SetOrJoinSink*>(DB::SetOrJoinSink*, std::shared_ptr&, DB::StorageSetOrJoinBase&, std::shared_ptr const&, String&, std::__fs::filesystem::path&&, String&&, bool&) @ 0x000000003356c2cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::StorageSetOrJoinBase::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000033560961 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageJoin.cpp:0: DB::StorageJoin::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000032ef14ab in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Transforms/buildPushingToViewsChain.cpp:0: DB::buildPushingToViewsChain(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, bool, std::shared_ptr, std::shared_ptr, std::atomic*, bool, DB::Block const&) @ 0x000000003597e761 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:291: DB::InterpreterInsertQuery::buildSink(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::atomic*) @ 0x00000000314a79c7 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:534: DB::InterpreterInsertQuery::execute() @ 0x00000000314afcbd in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 24. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 25. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:26.051456 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpf95e383c-cdc9-49cf-a15e-984e1a8dde83' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.051660 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpa79fa78f-f179-4c49-a1bc-535810a91708' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.054472 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.055815 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.061719 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4253505 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.200206 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp2e00f813-2400-44f6-8949-6fdeb4979077' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.200980 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp25265d34-0273-43e8-9e8d-2a2ee868ee48' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.205186 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.206135 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.216761 [ 1997 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.216945 [ 2043 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.217651 [ 2039 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.218307 [ 1995 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.218826 [ 2071 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.219061 [ 1979 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.257025 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpb0a6de01-7f33-442e-af2c-86fff6dde937' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.257542 [ 2487 ] {ac55ff6a-abeb-49e1-b648-c6ee4b7c3cd4} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34188) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:26.260042 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.339676 [ 2307 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4195809 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5387af in /usr/bin/clickhouse 7. ./build_docker/./src/Common/HashTable/HashTable.h:521: HashTable, DB::ColumnString, true, true>, DB::ReverseIndexHash, HashTableGrowerWithPrecalculation<8ul>, Allocator>::alloc(HashTableGrowerWithPrecalculation<8ul> const&) @ 0x000000002ee50471 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/HashTable/HashTable.h:0: DB::ReverseIndex::buildIndex() @ 0x000000002ee4c381 in /usr/bin/clickhouse 9. ./build_docker/./base/base/../base/StringRef.h:303: DB::ReverseIndex::insert(StringRef) @ 0x000000002ee51318 in /usr/bin/clickhouse 10. ./build_docker/./src/Columns/ColumnUnique.h:0: COW::mutable_ptr DB::ColumnUnique::uniqueInsertRangeImpl(DB::IColumn const&, unsigned long, unsigned long, unsigned long, DB::ColumnVector::MutablePtr&&, DB::ReverseIndex*, unsigned long) @ 0x000000002ee4b30e in /usr/bin/clickhouse 11. ./build_docker/./src/Columns/ColumnUnique.h:589: DB::ColumnUnique::uniqueInsertRangeFrom(DB::IColumn const&, unsigned long, unsigned long) @ 0x000000002ee44f91 in /usr/bin/clickhouse 12. ./build_docker/./src/Columns/ColumnLowCardinality.cpp:0: DB::ColumnLowCardinality::Dictionary::compact(DB::IColumnUnique const&, COW::mutable_ptr&) @ 0x0000000032633fd6 in /usr/bin/clickhouse 13. ./build_docker/./src/Columns/ColumnLowCardinality.cpp:0: DB::ColumnLowCardinality::cutAndCompact(unsigned long, unsigned long) const @ 0x00000000326338c0 in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::SerializationLowCardinality::serializeBinaryBulkWithMultipleStreams(DB::IColumn const&, unsigned long, unsigned long, DB::ISerialization::SerializeBinaryBulkSettings&, std::shared_ptr&) const @ 0x000000002f1cbe1c in /usr/bin/clickhouse 15. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:0: DB::SerializationArray::serializeBinaryBulkWithMultipleStreams(DB::IColumn const&, unsigned long, unsigned long, DB::ISerialization::SerializeBinaryBulkSettings&, std::shared_ptr&) const @ 0x000000002f160836 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector> const&) @ 0x000000003415ef05 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:186: DB::MergeTreeDataPartWriterCompact::writeDataBlockPrimaryIndexAndSkipIndices(DB::Block const&, std::vector> const&) @ 0x000000003415d9a0 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x00000000341604a0 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:422: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&) @ 0x0000000034162472 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c2f49 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ac548 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ca0bd9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.339804 [ 2487 ] {ac55ff6a-abeb-49e1-b648-c6ee4b7c3cd4} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:26.354320 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpad2ae912-24ed-4480-8e3b-a06ef9d643dc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.357261 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.404454 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpe33f1ad9-f76a-492f-8837-b95676ac74b7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.407088 [ 2191 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.407850 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.409029 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.410158 [ 18599 ] {7ce8a079-d40b-4833-930d-ff2c1595bf05} DistributedSink: Structure does not match (remote: n Int8 Int8(size = 0), local: n UInt64 UInt64(size = 1)), implicit conversion will be done. 2024.10.22 00:33:26.417439 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.493041 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpa6efc079-0127-4f28-9d7f-58813153fe73' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.500340 [ 2192 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp4fc0a2b4-5562-4f1d-8652-6d91926f10a9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.542156 [ 1911 ] {7ce8a079-d40b-4833-930d-ff2c1595bf05} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Insertion status: Wrote 1 blocks and 1 rows on shard 0 replica 0, 127.0.0.1:9000 (average 188 ms per block) Wrote 0 blocks and 0 rows on shard 1 replica 0, 127.0.0.2:9000 (average 10 ms per block) . (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34162) (comment: 01683_dist_INSERT_block_structure_mismatch.sql) (in query: INSERT INTO dist_01683 VALUES ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::Connection::sendData(DB::Block const&, String const&, bool) @ 0x0000000034c0b748 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Connection::sendQuery(DB::ConnectionTimeouts const&, String const&, std::unordered_map, std::equal_to, std::allocator>> const&, String const&, unsigned long, DB::Settings const*, DB::ClientInfo const*, bool, std::function) @ 0x0000000034c0985b in /usr/bin/clickhouse 13. ./build_docker/./src/QueryPipeline/RemoteInserter.cpp:54: DB::RemoteInserter::RemoteInserter(DB::Connection&, DB::ConnectionTimeouts const&, String const&, DB::Settings const&, DB::ClientInfo const&) @ 0x0000000033c0cf74 in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Sinks/RemoteSink.h:0: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033c58391 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:26.546702 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.548538 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.549288 [ 1911 ] {7ce8a079-d40b-4833-930d-ff2c1595bf05} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Insertion status: Wrote 1 blocks and 1 rows on shard 0 replica 0, 127.0.0.1:9000 (average 188 ms per block) Wrote 0 blocks and 0 rows on shard 1 replica 0, 127.0.0.2:9000 (average 10 ms per block) . (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::Connection::sendData(DB::Block const&, String const&, bool) @ 0x0000000034c0b748 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Connection::sendQuery(DB::ConnectionTimeouts const&, String const&, std::unordered_map, std::equal_to, std::allocator>> const&, String const&, unsigned long, DB::Settings const*, DB::ClientInfo const*, bool, std::function) @ 0x0000000034c0985b in /usr/bin/clickhouse 13. ./build_docker/./src/QueryPipeline/RemoteInserter.cpp:54: DB::RemoteInserter::RemoteInserter(DB::Connection&, DB::ConnectionTimeouts const&, String const&, DB::Settings const&, DB::ClientInfo const&) @ 0x0000000033c0cf74 in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Sinks/RemoteSink.h:0: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033c58391 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:26.558750 [ 1911 ] {} TCPHandler: Code: 101. DB::NetException: Unexpected packet Data received from client. (UNEXPECTED_PACKET_FROM_CLIENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, char const (&) [44]) @ 0x0000000034f1d2ee in /usr/bin/clickhouse 3. ./build_docker/./src/Server/TCPHandler.cpp:1848: DB::TCPHandler::receiveUnexpectedData(bool) @ 0x0000000034f0c848 in /usr/bin/clickhouse 4. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x0000000034eec3ef in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed58db in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 11. ? @ 0x00007f11b339dac3 in ? 12. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:26.690278 [ 2189 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.695097 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp6127c31c-fbf1-4d3c-bad0-054f8ecf5a97' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.699269 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.702951 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmped96f9f4-e411-4757-a550-1eedd97f6586' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.705966 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.725942 [ 2196 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp386989e3-bdc4-4368-aa69-334597333d23' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.730362 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.742511 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp3c8476e5-211e-439b-93f2-de3ea09b0ec9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.759698 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.772133 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp92f49aea-23f1-40c4-a32f-ba0f02731c99' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.779534 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.792042 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.803904 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp33ef92c5-924d-49f0-9073-5a4e72dcfada' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.814267 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.855734 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.893558 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpcf609981-426f-4910-9f2d-308613edab85' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.896814 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:26.933169 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp6f9591fb-ea60-4a89-aada-1687c9d13f4f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:26.943354 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.060479 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.120983 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc9e79977-501c-4e0b-b3b5-9dc2494fdf5e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.122969 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.140505 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp3f34660b-640e-434c-9c26-086195e47192' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.148787 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.168809 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe7d7f15d-ae9e-43bd-82f4-f49e50dd2f3c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.170536 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.218899 [ 2012 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.218948 [ 2104 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.219730 [ 1993 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.223419 [ 2052 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.223508 [ 2057 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.302920 [ 2188 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.304706 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.307686 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpcd613ab5-c4c4-47fc-91c5-34931d4f4fae' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.313760 [ 1911 ] {7d86c3ab-2ce2-4dc0-8955-937a13e8851a} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34248) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:27.315485 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.324561 [ 2189 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp7ed0934a-e336-425a-abd8-13dcd917e4d3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.326132 [ 1911 ] {7d86c3ab-2ce2-4dc0-8955-937a13e8851a} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:27.331764 [ 2052 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.334633 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.375628 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.425762 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpba0e34c7-4ead-4cb5-a13b-bd18958488b9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.436068 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.490960 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp978e266c-10f0-42bc-b82a-e0efd616d58b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.494113 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.520813 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.574822 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpb92b1ccf-7847-48b6-ba57-85efdd6a944b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.587546 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.595387 [ 2194 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.598216 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.644616 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb00cd01b-accb-466c-8e0d-1064dedf536a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.645359 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp8f97c055-f388-4ae1-9b5e-dd597985376f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.646326 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.646864 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.661325 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp8efe000e-944b-49d8-a7bd-f05ce6b3a856' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.668691 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.714305 [ 2195 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.715510 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.780764 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp194865b1-64cf-4360-a587-f20c63265050' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.787311 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.845579 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc254ef29-7b31-4129-9d6c-481c48dfdcea' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.848421 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.864868 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp1489a0b4-0000-4b57-9ddf-cf15b3644e26' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.866804 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.881647 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpf8717561-6c06-4c85-ad7f-441d28232693' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.884158 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.904497 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp972311a6-d99e-40ea-b4b8-fc9370609b48' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.906649 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.914107 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp0ddb3f14-15d4-4d1d-a4cd-8400667e87a7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.916251 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.947164 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp5e428e24-984e-454a-886e-bc3139b19bcc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.958191 [ 2198 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.959878 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.960102 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:27.960798 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd658165b-05eb-4142-83cf-b97c8e014036' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:27.980909 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.022626 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp0ca36a5c-e0c7-49b7-bdda-563e28bd596d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.032290 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp2b53404b-a24c-4316-953e-96cc20bc36cb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.036587 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.039051 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.183936 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpf0ea7df7-d722-4bb6-9d93-2ef11d020c10' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.184101 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb5dddd66-154b-4d1a-a28b-6a5e94a07024' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.184566 [ 2184 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp56b08cc3-9cd4-4897-8174-7aca2aeeab11' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.187322 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.189197 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.190127 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.220592 [ 2062 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.224829 [ 2025 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.228728 [ 2042 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.300422 [ 2186 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.302106 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.320779 [ 2058 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.329321 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp8910cefc-146b-49d7-83c3-26a197be33e9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.332856 [ 1911 ] {295465a8-8d01-4582-9f9c-bdcd946c8699} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34270) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:28.333489 [ 2004 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.334020 [ 2053 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.334835 [ 1911 ] {295465a8-8d01-4582-9f9c-bdcd946c8699} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:28.348167 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.423973 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.454049 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpe8849112-d7ce-46db-b843-f43406633a60' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.455588 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.470704 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp27ab0419-2173-4fa8-9ef5-d60cf332cb85' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.472744 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.489335 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpd5cdd36e-1e62-4477-b654-a77014e9b2cc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.490974 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.512934 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe432d51a-92be-4aa4-9838-a36f5b3f5c39' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.525968 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.568167 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp4bd99751-72ce-4e8d-87d3-59efaeffedea' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.571692 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.615752 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpa37d8200-b7f3-4337-bfe8-81a0294151c8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.618516 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.625285 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp4c42f9b0-3ead-4a6a-9b1b-22c6e36f8e06' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.628085 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.632760 [ 2187 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.633889 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.646252 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 4522919 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 7. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 8. ./build_docker/./src/Common/PODArray.h:321: DB::ColumnString::insert(DB::Field const&) @ 0x00000000326f278b in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/TextLog.cpp:71: DB::TextLogElement::appendToBlock(std::vector::mutable_ptr, std::allocator::mutable_ptr>>&) const @ 0x0000000031e5e471 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cedaac in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031ceb946 in /usr/bin/clickhouse 12. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d96ae39 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.736263 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp001803ee-94da-4766-b615-96d5bd91c65a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.740443 [ 2198 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpa833d8bb-692f-4a06-91c8-c34e9725bd8f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.740859 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.743381 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.743735 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp67be6b90-7e30-4f7d-b45e-067fa3855b29' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.747562 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.930868 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb37f9219-be0c-48ee-a364-c0eab17427e5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.932307 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp349a024e-abc7-401b-b38f-de99a4c7df0b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:28.933424 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.938117 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.945000 [ 2193 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:28.945993 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.033469 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp04fc4ac1-57ad-456f-9991-9884f664997e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:29.036577 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.136580 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpfce8803d-049b-48c8-9aa6-563ac61cebcc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:29.149319 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.167390 [ 2190 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.169260 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.181106 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp87678358-0524-4928-ba6e-315c001c73e9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:29.191263 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.196370 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.222005 [ 2014 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.226341 [ 1976 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.230492 [ 2045 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.241354 [ 1911 ] {de796f73-1ea5-49d5-af22-5af9d8064172} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38450) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:29.247198 [ 1911 ] {de796f73-1ea5-49d5-af22-5af9d8064172} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:29.322402 [ 2052 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.334973 [ 2081 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.345854 [ 2065 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.347468 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb43ada35-7ed1-41ca-b13f-2e8b374e50b8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:29.354375 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.485290 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp978959ef-e31d-40b5-a243-d2cc7556e903' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:29.486414 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp0283c5c1-ffd1-48ee-81af-420df1ce0213' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:29.489551 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.492894 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.526183 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp17516c83-63b3-4c58-bcc9-edd738c7e068' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:29.529401 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.544643 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp1ec34f14-1854-4e57-af94-54f699bbba36' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:29.547462 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.560502 [ 2194 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp6b34d51f-bd96-4587-995f-39597bcbb1bb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:29.575602 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.608219 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpbd6dee2e-81fe-4cf0-8174-bac8f659053c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:29.610375 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp2be0713e-5ec1-4687-98ca-24630c6598bb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:29.623650 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.624915 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.656290 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpe1bc4007-da44-4a9e-9a8f-3124e3b3d4b6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:29.662823 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.665754 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp93710fa9-5dc3-4715-9717-b0877ba7e1f2' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:29.672297 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.837941 [ 2196 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.840445 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:29.927452 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp0eea98c9-16ff-4a87-8505-dfe69508574d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:29.947866 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.016053 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp60788ec0-cf88-4e29-b211-5af09b9ce452' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.018831 [ 2199 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpdf4a6b44-82c1-4743-8f68-b037d0e62887' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.019363 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.021711 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.041002 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpb83d6915-55e5-44b4-bdc5-92e3297f3488' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.045620 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.058195 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpa57b7c0b-5186-41d7-b345-2c51473d2351' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.072012 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.077584 [ 1911 ] {dd4db582-bcf7-45af-8731-6738aa3710a0} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38458) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:30.081060 [ 1911 ] {dd4db582-bcf7-45af-8731-6738aa3710a0} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:30.100723 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp50ef54de-599e-4382-86b0-906c9b2852aa' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.102378 [ 2189 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.104425 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.104951 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.122472 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp3911823d-252a-46e5-ade8-4fb930b66da1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.129452 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.190685 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp9b523eee-203b-421e-9d95-441c87856642' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.204915 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc745a7b5-3aab-4a63-97c3-e7fcd03c1487' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.208285 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.233595 [ 2093 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.234188 [ 2008 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.234435 [ 2079 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.249018 [ 2190 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.249850 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.293286 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.320070 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp8ab259ca-0e1f-4ac1-bb3e-c2f2975e09b3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.321496 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.322122 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.334126 [ 2053 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.336749 [ 2099 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.357948 [ 2026 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.417856 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp9f58098c-ec6b-4cbc-9508-87d44a5d7b30' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.420575 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.436783 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp6a5cd0cc-fd42-4287-93d5-b12591c1bb75' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.438429 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.459957 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp02093ea3-efe0-40c6-bb82-55555728b1b2' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.460618 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpd4e5026f-6f84-459b-bd81-5cca50f4fd11' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.462617 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.463213 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.496890 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp56affab4-ad68-4774-9a6e-8a60cb574243' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.600020 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.609473 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp26f3145d-a485-4776-bc5b-a6e7c36c8512' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.614306 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.622625 [ 2193 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.624915 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.759929 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.779016 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp82711f30-283c-47da-9163-08711b146131' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.786575 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.788400 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp07755018-ee77-4368-9839-70ade6efacd1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.811332 [ 2194 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp2c1280ca-3dfc-4414-bf0c-a2b8075e11bb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.815283 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.821251 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.908355 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp93124052-96ba-4f4f-89a4-a64c2b7828ef' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:30.918912 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:30.960093 [ 1911 ] {8a7e79b8-6c9c-41f7-a113-1774146c6d44} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38474) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:30.975450 [ 1911 ] {8a7e79b8-6c9c-41f7-a113-1774146c6d44} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:31.003491 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp45fe8ee8-0f5f-4316-87ce-0b72b66e3b73' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:31.017951 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.080049 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp5ce36bf3-1cbc-4574-ad2c-3022f0691163' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:31.093230 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.151994 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp6419995a-2839-4605-b21c-cd03ed4b5de5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:31.153896 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.172874 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp2f5ddc3a-93aa-4ac2-a10d-1a3c371c74ef' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:31.175162 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.188119 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpfac3c3e2-00ac-4a64-81a3-b9648f75c4f9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:31.190053 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.206686 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpa42b47c0-fe1d-4198-8109-a31afa8b27b4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:31.209274 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.235663 [ 2057 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.236128 [ 2080 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.236392 [ 2089 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.311227 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp9de0cdf7-3162-47a0-94e5-af6483da5b29' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:31.314179 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.335790 [ 2104 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.338540 [ 2052 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.341207 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp28f02d81-741a-4169-bcda-79f4d8b2fe2f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:31.359737 [ 1993 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.359472 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.385038 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpa8e86c98-7db7-452c-8689-267b74901cb8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:31.387871 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.408530 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpfca9c8e0-578b-46d2-ba78-cdb69014a3a4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:31.417504 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.418821 [ 2193 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.420953 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.802616 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 5121605 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.807281 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp96f6b0a2-7e6a-46ca-8f82-c129a2a43369' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:31.812587 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.813155 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe62f660f-d1ec-412c-9406-338358b7654b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:31.818364 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.841439 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp3ef11285-fd2b-42ef-88c3-606ca0f7f301' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:31.856316 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.856851 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp5d3a5311-cbfa-4275-a8f4-713dd99dc31d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:31.860407 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.864249 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.864813 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_54_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1185823 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.887795 [ 11869 ] {eed736b7-91e1-4c90-8aab-717994a452f7} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38486) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:31.893769 [ 11869 ] {eed736b7-91e1-4c90-8aab-717994a452f7} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:31.896159 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp5a3a44bd-aed9-4e31-bd09-99f975f4150b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:31.902635 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.908458 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp821fa122-1d65-47bb-8004-b8fd15e594fa' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:31.929592 [ 2487 ] {ec470882-f8f3-4a6d-978d-0ac3c04588a1} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34212) (comment: 01162_strange_mutations.sh) (in query: select count() from t), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/Aggregator.cpp:1511: DB::Aggregator::executeOnBlock(DB::Block const&, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdaaa68 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::initGenerate() @ 0x0000000035745847 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744e07 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:31.933928 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.933908 [ 2190 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.936905 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:31.936977 [ 2487 ] {ec470882-f8f3-4a6d-978d-0ac3c04588a1} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/Aggregator.cpp:1511: DB::Aggregator::executeOnBlock(DB::Block const&, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdaaa68 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::initGenerate() @ 0x0000000035745847 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744e07 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:31.989344 [ 2241 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 5065313 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c726b9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.014551 [ 2192 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp1a45fc40-1657-4c7d-aa66-0452faf44373' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:32.017027 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.060245 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc23179ee-256f-42d3-9c4a-8549c14cc729' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:32.063274 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.198497 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp48be4a7b-207d-4f18-b756-1541b6125eed' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:32.202081 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.237948 [ 2101 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.238368 [ 2005 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.239030 [ 2084 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.337796 [ 2107 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.340144 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp63695bd6-2611-421e-9711-b80ed5261db9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:32.340479 [ 1987 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.340876 [ 11424 ] {4f4e35ce-315b-44d1-baaa-f49b8a7b9004} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34242) (comment: 02705_projection_and_ast_optimizations_bug.sql) (in query: CREATE TABLE t1 (`c0` Int32) ENGINE = MergeTree PARTITION BY -c0 ORDER BY c0 SETTINGS index_granularity = 61595, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 14603, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 240873, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 1, index_granularity_bytes = 20620310, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 57678, primary_key_compress_block_size = 85959), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:33:32.344821 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.349871 [ 11424 ] {4f4e35ce-315b-44d1-baaa-f49b8a7b9004} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:33:32.361447 [ 1988 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.371494 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp017ff336-3614-4bd1-a267-19e51c37af6f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:32.376309 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.378166 [ 2184 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.379585 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.690062 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp8d3c29b0-2939-485b-a4d6-8d00c63e734b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:32.697138 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.703436 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp82ad962c-ca33-4d9e-afd6-4154875f3fbc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:32.705752 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.753109 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp46f85243-bf7b-4fc4-8c3d-f58c0049e712' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:32.754253 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpa0ad29d2-7128-47c5-b286-c70b059750e6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:32.757819 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.758611 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.792071 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp4bb2d593-c7b5-4fd7-8d95-841a3aee0129' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:32.794770 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.801945 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.802958 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp6541621c-0de3-410b-918a-51850c16616c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:32.805532 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.813717 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpecba815e-c2fa-4b50-a903-116919de58dc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:32.818481 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.848346 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp9fcea4b8-d4fd-4f68-b0a5-0223ce7c3802' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:32.852527 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.863780 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 4437285 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.873805 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp7b950d7c-d037-41ab-a5ee-64b79debebb7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:32.875839 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.880065 [ 2188 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.882377 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.896465 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:32.936643 [ 11424 ] {b772c65e-1839-4e55-8572-3e1ee4f95401} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38518) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:32.940755 [ 11424 ] {b772c65e-1839-4e55-8572-3e1ee4f95401} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:32.999363 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp1097810e-5260-4ff0-86d5-fd8cf3e21a51' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:33.034061 [ 11851 ] {33162ae0-fdb0-4450-8edf-36421225908e} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column Title): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34196) (comment: 00176_distinct_limit_by_limit_bug_43377.sql) (in query: SELECT count() FROM ( SELECT DISTINCT Title, SearchPhrase FROM test.hits WHERE (SearchPhrase != '') AND (NOT match(Title, '[а-яА-ЯёЁ]')) AND (NOT match(SearchPhrase, '[а-яА-ЯёЁ]')) LIMIT 1 BY Title LIMIT 10 );), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:0: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function> (String const&, unsigned long)>&&, std::vector> const&, DB::ReadSettings const&, std::shared_ptr, bool) @ 0x000000002dd23a52 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]> const&, DB::ReadSettings const&, std::optional, std::optional) const::$_0, std::vector> const&, DB::ReadSettings&, std::shared_ptr, bool>(DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const::$_0&&, std::vector> const&, DB::ReadSettings&, std::shared_ptr&&, bool&&) @ 0x000000002f506d70 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505bac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker::__call_impl const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034448e97 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034443992 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x0000000034443033 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344442df in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 2024.10.22 00:33:33.035313 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 4270682 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:33.035644 [ 11850 ] {8edfa782-7826-4593-915d-9a2262a3f3e6} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048810 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: Cache info: Buffer path: test/wqr/mplvrnzwhwkvzmdzxlgouoicspnyx, hash key: 8fc54405d511604af20050b8ce1200cf, file_offset_of_buffer_end: 0, read_until_position: 60, internal buffer end: 60, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 8edfa782-7826-4593-915d-9a2262a3f3e6:2387, file segment info: File segment: [0, 59], key: 8fc54405d511604af20050b8ce1200cf, state: DOWNLOADING, downloaded size: 0, reserved size: 60, downloader id: 8edfa782-7826-4593-915d-9a2262a3f3e6:2387, current write offset: 0, caller id: 8edfa782-7826-4593-915d-9a2262a3f3e6:2387, kind: Regular, unbound: 0: (while reading column type): (while reading from part /var/lib/clickhouse/disks/s3/store/6e4/6e4fe0b1-5b27-4b1d-845a-88e783da8be0/202410_1_49_8/ in table system.query_log (6e4fe0b1-5b27-4b1d-845a-88e783da8be0) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8022): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:34076) (comment: 02765_queries_with_subqueries_profile_events.sh) (in query: SELECT 1 CSE, 0 allow_experimental_analyzer, ProfileEvents['InsertQuery'] InsertQuery, ProfileEvents['SelectQuery'] SelectQuery, ProfileEvents['InsertQueriesWithSubqueries'] InsertQueriesWithSubqueries, ProfileEvents['SelectQueriesWithSubqueries'] SelectQueriesWithSubqueries, ProfileEvents['QueriesWithSubqueries'] QueriesWithSubqueries FROM system.query_log WHERE current_database = currentDatabase() AND type = 'QueryFinish' AND query_id = 'fadiitjpyp' FORMAT TSVWithNames;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 5. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 17. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec784a9 in /usr/bin/clickhouse 18. ./build_docker/./src/IO/ReadBuffer.h:72: DB::MergeTreeMarksLoader::loadMarksImpl() @ 0x00000000343aece8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::MergeTreeMarksLoader::loadMarks() @ 0x00000000343ac8a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/threadPoolCallbackRunner.h:43: std::__packaged_task_func> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'(), std::allocator> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'()>, std::shared_ptr ()>::operator()() @ 0x00000000343b2cba in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task ()>::operator()() @ 0x00000000343b7f6c in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:33.040338 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:33.051723 [ 11850 ] {8edfa782-7826-4593-915d-9a2262a3f3e6} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048810 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: Cache info: Buffer path: test/wqr/mplvrnzwhwkvzmdzxlgouoicspnyx, hash key: 8fc54405d511604af20050b8ce1200cf, file_offset_of_buffer_end: 0, read_until_position: 60, internal buffer end: 60, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 8edfa782-7826-4593-915d-9a2262a3f3e6:2387, file segment info: File segment: [0, 59], key: 8fc54405d511604af20050b8ce1200cf, state: DOWNLOADING, downloaded size: 0, reserved size: 60, downloader id: 8edfa782-7826-4593-915d-9a2262a3f3e6:2387, current write offset: 0, caller id: 8edfa782-7826-4593-915d-9a2262a3f3e6:2387, kind: Regular, unbound: 0: (while reading column type): (while reading from part /var/lib/clickhouse/disks/s3/store/6e4/6e4fe0b1-5b27-4b1d-845a-88e783da8be0/202410_1_49_8/ in table system.query_log (6e4fe0b1-5b27-4b1d-845a-88e783da8be0) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8022): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 5. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 17. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec784a9 in /usr/bin/clickhouse 18. ./build_docker/./src/IO/ReadBuffer.h:72: DB::MergeTreeMarksLoader::loadMarksImpl() @ 0x00000000343aece8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::MergeTreeMarksLoader::loadMarks() @ 0x00000000343ac8a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/threadPoolCallbackRunner.h:43: std::__packaged_task_func> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'(), std::allocator> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'()>, std::shared_ptr ()>::operator()() @ 0x00000000343b2cba in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task ()>::operator()() @ 0x00000000343b7f6c in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:33.205338 [ 11851 ] {33162ae0-fdb0-4450-8edf-36421225908e} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: (while reading column Title): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:0: DB::ReadBufferFromRemoteFSGather::ReadBufferFromRemoteFSGather(std::function> (String const&, unsigned long)>&&, std::vector> const&, DB::ReadSettings const&, std::shared_ptr, bool) @ 0x000000002dd23a52 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]> const&, DB::ReadSettings const&, std::optional, std::optional) const::$_0, std::vector> const&, DB::ReadSettings&, std::shared_ptr, bool>(DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const::$_0&&, std::vector> const&, DB::ReadSettings&, std::shared_ptr&&, bool&&) @ 0x000000002f506d70 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:0: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505bac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker::__call_impl const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034448e97 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034443992 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x0000000034443033 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344442df in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 2024.10.22 00:33:33.239936 [ 2059 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:33.240072 [ 2029 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:33.240532 [ 1980 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:33.339757 [ 2019 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:33.343078 [ 2017 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:33.373163 [ 2006 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:34.068014 [ 1911 ] {ea7b9645-ad03-4c1b-a22e-47ed6e4d14e4} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38556) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:34.337152 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 4276919 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector> const&, std::vector, std::allocator>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x0000000033d5a5ac in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IMergeTreeDataPart.cpp:117: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x0000000033d58e1e in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1420: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x00000000345c6ff2 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c4485 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ac548 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:34.337311 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:34.337335 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1118460 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:34.608247 [ 1912 ] {88d3aa8e-bf16-4e5a-932a-fd1d085c9fe0} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:42770) (comment: 00328_long_case_construction.sql) (in query: INSERT INTO multi_if_check(col1, col2, col3, col4) VALUES), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageLog.cpp:328: DB::LogSink::Stream::Stream(std::shared_ptr const&, String const&, unsigned long, std::shared_ptr, unsigned long) @ 0x000000003374bc3f in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::pair* std::construct_at[abi:v15000], std::piecewise_construct_t const&, std::tuple, std::tuple const&, String const&, unsigned long&&, std::shared_ptr&&, unsigned long const&>, std::pair*>(std::pair*, std::piecewise_construct_t const&, std::tuple&&, std::tuple const&, String const&, unsigned long&&, std::shared_ptr&&, unsigned long const&>&&) @ 0x000000003374b687 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__tree:2096: std::pair, std::__tree_node, void*>*, long>, bool> std::__tree, std::__map_value_compare, std::less, true>, std::allocator>>::__emplace_unique_key_args, std::tuple const&, String const&, unsigned long&&, std::shared_ptr&&, unsigned long const&>>(String const&, std::piecewise_construct_t const&, std::tuple&&, std::tuple const&, String const&, unsigned long&&, std::shared_ptr&&, unsigned long const&>&&) @ 0x000000003374afd4 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/map:1281: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003373cb00 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 17. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::LogSink::writeData(DB::NameAndTypePair const&, DB::IColumn const&) @ 0x00000000337202f9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageLog.cpp:0: DB::LogSink::consume(DB::Chunk) @ 0x000000003371f83f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processInsertQuery() @ 0x0000000034eee177 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:503: DB::TCPHandler::runImpl() @ 0x0000000034ed6f7c in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:33:34.608248 [ 1911 ] {ea7b9645-ad03-4c1b-a22e-47ed6e4d14e4} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:34.608250 [ 2072 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:34.608658 [ 2045 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:34.608719 [ 1976 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:34.630411 [ 1912 ] {88d3aa8e-bf16-4e5a-932a-fd1d085c9fe0} FileChecker: Will truncate file store/4b0/4b0dcdbb-803f-4c5c-a729-ce1db9761a36/col1.bin that has size 170 to size 136 2024.10.22 00:33:34.849662 [ 2065 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:34.849881 [ 1981 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:34.850140 [ 1985 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:34.926826 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 4198715 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x00000000345c94fd in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c4485 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ac548 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c41c86 in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d960d79 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:34.927102 [ 1912 ] {88d3aa8e-bf16-4e5a-932a-fd1d085c9fe0} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/StorageLog.cpp:328: DB::LogSink::Stream::Stream(std::shared_ptr const&, String const&, unsigned long, std::shared_ptr, unsigned long) @ 0x000000003374bc3f in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::pair* std::construct_at[abi:v15000], std::piecewise_construct_t const&, std::tuple, std::tuple const&, String const&, unsigned long&&, std::shared_ptr&&, unsigned long const&>, std::pair*>(std::pair*, std::piecewise_construct_t const&, std::tuple&&, std::tuple const&, String const&, unsigned long&&, std::shared_ptr&&, unsigned long const&>&&) @ 0x000000003374b687 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__tree:2096: std::pair, std::__tree_node, void*>*, long>, bool> std::__tree, std::__map_value_compare, std::less, true>, std::allocator>>::__emplace_unique_key_args, std::tuple const&, String const&, unsigned long&&, std::shared_ptr&&, unsigned long const&>>(String const&, std::piecewise_construct_t const&, std::tuple&&, std::tuple const&, String const&, unsigned long&&, std::shared_ptr&&, unsigned long const&>&&) @ 0x000000003374afd4 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/map:1281: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003373cb00 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 17. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::LogSink::writeData(DB::NameAndTypePair const&, DB::IColumn const&) @ 0x00000000337202f9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageLog.cpp:0: DB::LogSink::consume(DB::Chunk) @ 0x000000003371f83f in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processInsertQuery() @ 0x0000000034eee177 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:503: DB::TCPHandler::runImpl() @ 0x0000000034ed6f7c in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:33:34.957440 [ 2241 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4952545 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c726b9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:34.959452 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1221956 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a5a2 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:34.971687 [ 12062 ] {728a80ff-a99e-49ff-aafc-b84725c7ccf0} executeQuery: Code: 48. DB::Exception: Table engine Join supports only DELETE mutations. (NOT_IMPLEMENTED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38604) (comment: 01162_strange_mutations.sh) (in query: ALTER TABLE test UPDATE test = (SELECT groupArray(id) FROM t1)[n - 99] WHERE 1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [49]) @ 0x000000000e9d4c69 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageJoin.cpp:120: DB::StorageJoin::checkMutationIsPossible(DB::MutationCommands const&, DB::Settings const&) const @ 0x0000000032ef38e7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112b72d in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:34.991496 [ 12062 ] {728a80ff-a99e-49ff-aafc-b84725c7ccf0} TCPHandler: Code: 48. DB::Exception: Table engine Join supports only DELETE mutations. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [49]) @ 0x000000000e9d4c69 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageJoin.cpp:120: DB::StorageJoin::checkMutationIsPossible(DB::MutationCommands const&, DB::Settings const&) const @ 0x0000000032ef38e7 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112b72d in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:35.014622 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1682339 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_11_11_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.040021 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 4236357 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.046654 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpf4bba7f7-aebb-4dc6-b58a-96b1e74844b6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:35.062017 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpaa8eb3c5-e59c-4fcc-9cb4-d746df9d6f7f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:35.062972 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.065542 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.083609 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.238517 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp0c5a363d-3456-4c85-87d7-1182a0138ceb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:35.271292 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp6d3877b0-dd8c-41ff-96cb-4ee21c011270' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:35.286287 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 5028385 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.288791 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.332759 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_54_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1229324 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/memcpySmall.h:40: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x00000000326f2a83 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl>(DB::SortingQueueImpl&) @ 0x0000000035af6890 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::SortingQueueImpl, DB::SortingQueueImpl>&>(std::__variant_detail::__visitation::__variant::__value_visitor&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::SortingQueueImpl, DB::SortingQueueImpl>&) @ 0x0000000035a6e937 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/variant:637: DB::MergingSortedAlgorithm::merge() @ 0x0000000035a61456 in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform::work() @ 0x0000000031b27a83 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 27. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.347775 [ 2198 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp9689ba51-65da-4d18-a7fb-3a0ed07b53fc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:35.384647 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.390103 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.439069 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpb551a21c-385a-4187-b527-6d8244cb2bc8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:35.445392 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.449392 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp949c66b3-fbdd-4532-9c43-c88fb1df2dd7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:35.464455 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.517272 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpdaa6ee29-2b69-41b2-a438-9561543c9a79' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:35.517734 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp9e10b39f-6d33-4ded-8283-52a0d788642e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:35.522774 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.527078 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.576849 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp7e2d08a1-5170-4196-a58a-2ea5d491e13c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:35.588573 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.637347 [ 1988 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.637404 [ 2031 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.637911 [ 1997 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.649470 [ 1911 ] {7161c34b-136c-4f47-834f-37ff6df9c282} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38616) (comment: 01162_strange_mutations.sh) (in query: select count(), sum(n), sum(test) from test), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/Aggregator.cpp:1511: DB::Aggregator::executeOnBlock(DB::Block const&, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdaaa68 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::initGenerate() @ 0x0000000035745847 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744e07 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:35.651882 [ 1911 ] {7161c34b-136c-4f47-834f-37ff6df9c282} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/Aggregator.cpp:1511: DB::Aggregator::executeOnBlock(DB::Block const&, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdaaa68 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::initGenerate() @ 0x0000000035745847 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744e07 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:35.717994 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpa9247906-6619-4e8d-a8d0-3cc733c305ba' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:35.723999 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.727473 [ 2196 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpa1848eef-43c3-4242-b169-dfd79a14638f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:35.733727 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.739720 [ 11869 ] {f5f6a029-1cb0-4e63-b444-d4e602611314} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38520) (comment: 00411_merge_tree_where_const_in_set.sql) (in query: INSERT INTO const_in_const VALUES), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 2024.10.22 00:33:35.745683 [ 11869 ] {f5f6a029-1cb0-4e63-b444-d4e602611314} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 2024.10.22 00:33:35.758972 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpee16bd38-3c23-443c-b339-bb08d526a000' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:35.766737 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpf37d4b02-ea0b-41e3-887a-55c470539af4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:35.767738 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.772006 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.831743 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp9f5dffc9-4e39-466c-9601-c1d97c6c4135' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:35.923848 [ 1911 ] {cac366de-d9fe-4220-9f0c-378b4e256a4b} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38640) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:35.923823 [ 12062 ] {28217b6c-537b-4ad0-8257-70bf46ca05ac} executeQuery: Code: 160. DB::Exception: The maximum sleep time is 3000000 microseconds. Requested: 2144650000 microseconds per block (of size 42893): while executing 'FUNCTION sleepEachRow(0.05 :: 1) -> sleepEachRow(0.05) UInt8 : 2'. (TOO_SLOW) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38632) (comment: 02725_sleep_max_time.sql) (in query: SELECT * FROM system.numbers WHERE sleepEachRow(0.05) LIMIT 10;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long const&, unsigned long&, unsigned long&) @ 0x000000001a907f06 in /usr/bin/clickhouse 3. DB::FunctionSleep<(DB::FunctionSleepVariant)1>::execute(std::vector> const&, std::shared_ptr const&, bool) const @ 0x000000001a90b548 in /usr/bin/clickhouse 4. DB::FunctionSleep<(DB::FunctionSleepVariant)1>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a90a191 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/FilterTransform.cpp:0: DB::FilterTransform::doTransform(DB::Chunk&) @ 0x00000000357cf577 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/FilterTransform.cpp:121: DB::FilterTransform::transform(DB::Chunk&) @ 0x00000000357cf12e in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:35.924171 [ 2030 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.924343 [ 2042 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.924494 [ 2025 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.967292 [ 12062 ] {28217b6c-537b-4ad0-8257-70bf46ca05ac} TCPHandler: Code: 160. DB::Exception: The maximum sleep time is 3000000 microseconds. Requested: 2144650000 microseconds per block (of size 42893): while executing 'FUNCTION sleepEachRow(0.05 :: 1) -> sleepEachRow(0.05) UInt8 : 2'. (TOO_SLOW), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long const&, unsigned long&, unsigned long&) @ 0x000000001a907f06 in /usr/bin/clickhouse 3. DB::FunctionSleep<(DB::FunctionSleepVariant)1>::execute(std::vector> const&, std::shared_ptr const&, bool) const @ 0x000000001a90b548 in /usr/bin/clickhouse 4. DB::FunctionSleep<(DB::FunctionSleepVariant)1>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a90a191 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/FilterTransform.cpp:0: DB::FilterTransform::doTransform(DB::Chunk&) @ 0x00000000357cf577 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/FilterTransform.cpp:121: DB::FilterTransform::transform(DB::Chunk&) @ 0x00000000357cf12e in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:35.968151 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp1ce2809b-d7a6-407c-af41-46b4231f9c14' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:35.968166 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.969913 [ 1911 ] {cac366de-d9fe-4220-9f0c-378b4e256a4b} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:35.977404 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:35.986143 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.087064 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_54_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1185823 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.091551 [ 2197 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp22f24901-761b-4d81-8564-92accb1e178a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:36.098367 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.121807 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp37730ebe-d2b0-4142-b3f5-439f4cabcdc5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:36.143409 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.214465 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp1efb0932-fd64-4ea2-8594-280815eb579d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:36.218919 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.260336 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp68a11fee-33db-4e7b-8b26-2a27bee885f7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:36.272292 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp29de41c3-5c03-4659-8ce8-044d4c20f758' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:36.274516 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.278495 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.280006 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 5160832 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.322374 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpeabea795-5afb-4a87-9582-bec71fc92e14' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:36.324602 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp13257511-bce6-4f48-a001-ec3ab753072b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:36.328546 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.331849 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.384819 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp5c6c1ae5-0355-4e11-8a5a-83f4342b71b4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:36.390767 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.513568 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp8a96b117-866c-48ea-83d4-48543137cf5b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:36.531862 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.639879 [ 1975 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.640131 [ 1977 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.640395 [ 2041 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.645516 [ 2190 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpda5c02a7-507f-4b12-a19b-566aac204e2d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:36.650113 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 4217970 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.651037 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.683678 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp2f707bab-13d3-4cdb-80cf-a50b68d717d7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:36.698678 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.703051 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpcddf729b-cca9-4f32-bc6c-24bf43a3fb44' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:36.706667 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.737589 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp852d4011-4bad-4227-a456-b8674756881f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:36.739771 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.875409 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 5236556 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x00000000343d6317 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x00000000343d5adf in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x00000000345c6dbf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c4485 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ac548 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c53899 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c51386 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.875451 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.916668 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp1e82899c-c52f-4d10-a1ae-a15e4a5d725c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:36.919148 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.926146 [ 2016 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.926479 [ 2000 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.927205 [ 2045 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.947695 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd91403da-0dfa-4a0f-b3db-e66e0190fda0' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:36.976923 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.977298 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpb6781282-2a04-4b5b-a986-48a2d102323a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:36.978840 [ 11424 ] {a567d988-dd55-4af0-a37b-139e35a9b457} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38700) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:36.980118 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:36.981692 [ 11424 ] {a567d988-dd55-4af0-a37b-139e35a9b457} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:36.998863 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_54_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1185823 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.012290 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp633476db-49d5-4646-bba8-c17f43468c88' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:37.016497 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.022930 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 5145911 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031cccb46 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d9693f9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.039259 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp82b1f45e-bdb0-4a1a-8ea4-15ea4de4d039' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:37.046778 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.083908 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp60179cb0-a600-4a3f-b95a-97c20c1ff24e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:37.089611 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.091158 [ 1911 ] {c343b359-fd10-486c-b1a6-dc3c0537b537} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38668) (comment: 00732_quorum_insert_lost_part_zookeeper_long.sql) (in query: CREATE TABLE quorum1 (`x` UInt32, `y` Date) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{database}/test_00732/quorum_lost', '1') PARTITION BY y ORDER BY x SETTINGS index_granularity = 57016, min_bytes_for_wide_part = 501384954, ratio_of_defaults_for_sparse_serialization = 0.4245390295982361, merge_max_block_size = 21992, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 52, min_merge_bytes_to_use_direct_io = 3591096694, index_granularity_bytes = 1428892, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 65970, primary_key_compress_block_size = 97449), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:33:37.091416 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp364e590e-ed34-4b56-99cc-71e118e32bb9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:37.099274 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.105558 [ 1911 ] {c343b359-fd10-486c-b1a6-dc3c0537b537} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:33:37.141640 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp183bb2d9-d72e-4906-ae5b-6559b995a719' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:37.151895 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.181229 [ 12062 ] {54d3b5e1-1232-4fcc-8214-9f3a1fddf0d7} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38694) (comment: 01511_alter_version_versioned_collapsing_merge_tree_zookeeper.sql) (in query: CREATE TABLE table_with_version_replicated_1 ( key UInt64, value String, version UInt8, sign Int8 ) ENGINE ReplicatedVersionedCollapsingMergeTree('/clickhouse/' || currentDatabase() || '/test_01511/{shard}/t', '1_{replica}', sign, version) ORDER BY key;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:33:37.191526 [ 12062 ] {54d3b5e1-1232-4fcc-8214-9f3a1fddf0d7} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:33:37.234545 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmpae7b0d68-3167-4bdb-8036-417869baa825' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:37.237649 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.262402 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe66c035c-d1b6-4bbb-b497-1f92aa709924' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:37.270797 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpb13369c2-5ad0-4b5d-b8ee-b0e6a71d6fd8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:37.431627 [ 11869 ] {17d3f2d3-696c-43b9-b8d8-1ce6d8259e84} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38714) (comment: 00163_column_oriented_formats.sh) (in query: INSERT INTO 00163_column_oriented SELECT ClientEventTime, MobilePhoneModel, ClientIP6 FROM test.hits ORDER BY ClientEventTime, MobilePhoneModel, ClientIP6 LIMIT 100), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::StorageFileSink::initialize() @ 0x0000000032eabcc6 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/StorageFile.cpp:0: DB::StorageFileSink::StorageFileSink(std::shared_ptr const&, String const&, std::unique_lock&&, int, bool, String, String const&, DB::CompressionMethod, std::optional const&, String, std::shared_ptr, int) @ 0x0000000032eaec80 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageFileSink* std::construct_at[abi:v15000] const&, String, std::unique_lock, int&, bool&, String&, String&, DB::CompressionMethod, std::optional&, String&, std::shared_ptr&, int&, DB::StorageFileSink*>(DB::StorageFileSink*, std::shared_ptr const&, String&&, std::unique_lock&&, int&, bool&, String&, String&, DB::CompressionMethod&&, std::optional&, String&, std::shared_ptr&, int&) @ 0x0000000032eadcdc in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::StorageFile::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000032e7c7c5 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/buildPushingToViewsChain.cpp:0: DB::buildPushingToViewsChain(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, bool, std::shared_ptr, std::shared_ptr, std::atomic*, bool, DB::Block const&) @ 0x000000003597e761 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:291: DB::InterpreterInsertQuery::buildSink(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::atomic*) @ 0x00000000314a79c7 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:534: DB::InterpreterInsertQuery::execute() @ 0x00000000314afcbd in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 22. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 23. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 27. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 28. ? @ 0x00007f11b339dac3 in ? 29. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:37.523929 [ 2186 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp182ee097-1d05-4c5b-a845-885f66eb9edf' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:37.815635 [ 2307 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 4202085 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long const*, unsigned long const*) @ 0x000000001d63315d in /usr/bin/clickhouse 8. ./build_docker/./src/Columns/ColumnString.cpp:32: DB::ColumnString::ColumnString(DB::ColumnString const&) @ 0x00000000326da21b in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper::clone() const @ 0x00000000326f2288 in /usr/bin/clickhouse 10. DB::IColumn::mutate(COW::immutable_ptr) @ 0x000000000cf55c03 in /usr/bin/clickhouse 11. void std::__invoke_void_return_wrapper::__call::immutable_ptr)::'lambda'(COW::chameleon_ptr&)&, COW::chameleon_ptr&>(DB::IColumn::mutate(COW::immutable_ptr)::'lambda'(COW::chameleon_ptr&)&, COW::chameleon_ptr&) @ 0x000000000cf5617b in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::ColumnTuple::forEachSubcolumn(std::function::chameleon_ptr&)>) @ 0x000000003275bc13 in /usr/bin/clickhouse 13. DB::IColumn::mutate(COW::immutable_ptr) @ 0x000000000cf55d4b in /usr/bin/clickhouse 14. void std::__invoke_void_return_wrapper::__call::immutable_ptr)::'lambda'(COW::chameleon_ptr&)&, COW::chameleon_ptr&>(DB::IColumn::mutate(COW::immutable_ptr)::'lambda'(COW::chameleon_ptr&)&, COW::chameleon_ptr&) @ 0x000000000cf5617b in /usr/bin/clickhouse 15. DB::IColumn::mutate(COW::immutable_ptr) @ 0x000000000cf55d4b in /usr/bin/clickhouse 16. ./build_docker/./src/Core/Block.cpp:470: DB::Block::mutateColumns() @ 0x000000002e6a0083 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x000000003415b994 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x00000000345c211c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345abb85 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ca0bd9 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c9e6c6 in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d966779 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.815685 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.819384 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.819900 [ 2002 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.820202 [ 11869 ] {17d3f2d3-696c-43b9-b8d8-1ce6d8259e84} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::StorageFileSink::initialize() @ 0x0000000032eabcc6 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/StorageFile.cpp:0: DB::StorageFileSink::StorageFileSink(std::shared_ptr const&, String const&, std::unique_lock&&, int, bool, String, String const&, DB::CompressionMethod, std::optional const&, String, std::shared_ptr, int) @ 0x0000000032eaec80 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageFileSink* std::construct_at[abi:v15000] const&, String, std::unique_lock, int&, bool&, String&, String&, DB::CompressionMethod, std::optional&, String&, std::shared_ptr&, int&, DB::StorageFileSink*>(DB::StorageFileSink*, std::shared_ptr const&, String&&, std::unique_lock&&, int&, bool&, String&, String&, DB::CompressionMethod&&, std::optional&, String&, std::shared_ptr&, int&) @ 0x0000000032eadcdc in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::StorageFile::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x0000000032e7c7c5 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/buildPushingToViewsChain.cpp:0: DB::buildPushingToViewsChain(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, bool, std::shared_ptr, std::shared_ptr, std::atomic*, bool, DB::Block const&) @ 0x000000003597e761 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:291: DB::InterpreterInsertQuery::buildSink(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::atomic*) @ 0x00000000314a79c7 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:534: DB::InterpreterInsertQuery::execute() @ 0x00000000314afcbd in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 22. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 23. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 26. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 27. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 28. ? @ 0x00007f11b339dac3 in ? 29. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:37.820349 [ 2106 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.820069 [ 2023 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.821478 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.863517 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_54_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1185823 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.865032 [ 2310 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 5165377 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cbf959 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.872310 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp9e4a829b-f5de-4ac8-9654-c317402bd8ec' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:37.875412 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.885479 [ 2199 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp9da26ffd-8144-4adf-9f8c-827fd749c99e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:37.886850 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpea1ba1f2-6acd-4136-aef4-e8e3461dac09' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:37.889468 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.913714 [ 11886 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.913870 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.936073 [ 1911 ] {e6e74e0a-6471-4152-97c8-447f24759b40} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38760) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:37.937328 [ 2051 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.937607 [ 2039 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:37.937819 [ 1979 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.041043 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp0d499358-0d96-4b01-b863-63b6b12fdbad' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.049919 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpa1847bf5-571c-4a0a-a3aa-fd561f48359d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.142269 [ 2197 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp2ba407cc-cb62-49f0-b6e9-961a4243f863' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.157379 [ 1911 ] {e6e74e0a-6471-4152-97c8-447f24759b40} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:38.159329 [ 11424 ] {7eef4cbe-325b-49f5-a7f5-60f670795b29} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1703999 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing Remote. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38738) (comment: 00900_entropy_shard.sql) (in query: SELECT round(entropy(number), 6) FROM remote('127.0.0.{1,2}', numbers(256));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:0: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x0000000034bfaee7 in /usr/bin/clickhouse 12. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::forceConnected(DB::ConnectionTimeouts const&) @ 0x0000000034c0443b in /usr/bin/clickhouse 13. ./build_docker/./src/Client/ConnectionEstablisher.cpp:51: DB::ConnectionEstablisher::run(PoolWithFailoverBase::TryResult&, String&) @ 0x0000000034c523f2 in /usr/bin/clickhouse 14. ./build_docker/./src/Client/ConnectionEstablisher.cpp:129: DB::ConnectionEstablisherAsync::Task::run(std::function, std::function) @ 0x0000000034c55da2 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x000000002edcf826 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: boost::context::detail::fiber_capture_record>::run() @ 0x000000002edcec1f in /usr/bin/clickhouse 17. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func>>(unsigned int, unsigned int) @ 0x000000002edcc7d4 in /usr/bin/clickhouse 2024.10.22 00:33:38.191676 [ 12062 ] {2747a534-e339-47bc-9350-41d60834ea9a} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1995120 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: while executing 'FUNCTION toString(number :: 0) -> toString(number) String : 4'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38744) (comment: 00086_concat_nary_const_with_nonconst_segfault.sql) (in query: SELECT extract(toString(number), '10000000') FROM system.numbers_mt WHERE concat(materialize('1'), '...', toString(number)) LIKE '%10000000%' LIMIT 1 ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd8d085 in /usr/bin/clickhouse 10. DB::ConvertImpl, DB::DataTypeString, DB::NameToString, DB::ConvertDefaultBehaviorTag>::execute(std::vector> const&, std::shared_ptr const&, unsigned long) @ 0x000000000c69a26e in /usr/bin/clickhouse 11. bool DB::callOnIndexAndDataType::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c690fa1 in /usr/bin/clickhouse 12. DB::FunctionConvert::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c68e793 in /usr/bin/clickhouse 13. DB::FunctionConvert::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c68c52a in /usr/bin/clickhouse 14. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 17. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Transforms/FilterTransform.cpp:0: DB::FilterTransform::doTransform(DB::Chunk&) @ 0x00000000357cf577 in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Transforms/FilterTransform.cpp:121: DB::FilterTransform::transform(DB::Chunk&) @ 0x00000000357cf12e in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 27. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:38.194902 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.197746 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.197726 [ 11424 ] {7eef4cbe-325b-49f5-a7f5-60f670795b29} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1703999 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing Remote. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:0: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x0000000034bfaee7 in /usr/bin/clickhouse 12. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::forceConnected(DB::ConnectionTimeouts const&) @ 0x0000000034c0443b in /usr/bin/clickhouse 13. ./build_docker/./src/Client/ConnectionEstablisher.cpp:51: DB::ConnectionEstablisher::run(PoolWithFailoverBase::TryResult&, String&) @ 0x0000000034c523f2 in /usr/bin/clickhouse 14. ./build_docker/./src/Client/ConnectionEstablisher.cpp:129: DB::ConnectionEstablisherAsync::Task::run(std::function, std::function) @ 0x0000000034c55da2 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x000000002edcf826 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: boost::context::detail::fiber_capture_record>::run() @ 0x000000002edcec1f in /usr/bin/clickhouse 17. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func>>(unsigned int, unsigned int) @ 0x000000002edcc7d4 in /usr/bin/clickhouse 2024.10.22 00:33:38.199320 [ 2694 ] {422f846b-0d39-43cd-a7e4-0dc071999120} executeQuery: Code: 107. DB::Exception: File /var/lib/clickhouse/store/8b4/8b4ae3aa-dc10-47eb-afab-8b10ba0d783c//data.Parquet doesn't exist. (FILE_DOESNT_EXIST) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38764) (comment: 00163_column_oriented_formats.sh) (in query: SELECT ClientEventTime from 00163_column_oriented), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032e790ee in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/IStorage.cpp:144: DB::IStorage::read(DB::QueryPlan&, std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032cc21d9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:2486: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000031538d65 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031526e5b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:38.204989 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {199b52ce-cf65-4b77-82a7-4c3bfc518400::202410_1_56_11}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1178559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.206036 [ 2694 ] {422f846b-0d39-43cd-a7e4-0dc071999120} TCPHandler: Code: 107. DB::Exception: File /var/lib/clickhouse/store/8b4/8b4ae3aa-dc10-47eb-afab-8b10ba0d783c//data.Parquet doesn't exist. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032e790ee in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/IStorage.cpp:144: DB::IStorage::read(DB::QueryPlan&, std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032cc21d9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:2486: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000031538d65 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031526e5b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:38.232379 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpe7a3a6c7-ec1a-4d87-b2e1-e3126bdcd10e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.238815 [ 2195 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1052630 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x00000000345c7541 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c4485 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:89: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c29f4 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x0000000033eab9b7 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033ebae9c in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x0000000033eabdb9 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.239853 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1052630 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x00000000345c7541 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c4485 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:89: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c29f4 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x0000000033eab9b7 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033ebae9c in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::MergeProjectionsStage::execute() @ 0x0000000033eabdb9 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.243017 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.246706 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp83fa2b78-f842-4bea-a2a1-958466c4995d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.251605 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.310985 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.340422 [ 12062 ] {2747a534-e339-47bc-9350-41d60834ea9a} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1995120 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: while executing 'FUNCTION toString(number :: 0) -> toString(number) String : 4'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd8d085 in /usr/bin/clickhouse 10. DB::ConvertImpl, DB::DataTypeString, DB::NameToString, DB::ConvertDefaultBehaviorTag>::execute(std::vector> const&, std::shared_ptr const&, unsigned long) @ 0x000000000c69a26e in /usr/bin/clickhouse 11. bool DB::callOnIndexAndDataType::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c690fa1 in /usr/bin/clickhouse 12. DB::FunctionConvert::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c68e793 in /usr/bin/clickhouse 13. DB::FunctionConvert::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c68c52a in /usr/bin/clickhouse 14. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 17. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Transforms/FilterTransform.cpp:0: DB::FilterTransform::doTransform(DB::Chunk&) @ 0x00000000357cf577 in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Transforms/FilterTransform.cpp:121: DB::FilterTransform::transform(DB::Chunk&) @ 0x00000000357cf12e in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 27. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:38.367013 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp70c078bd-a449-4a46-bd7b-ecbcd31e014c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.368078 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpdb23bd97-d09e-483a-bd27-e0506b49ba82' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.370735 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.373166 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.379518 [ 11880 ] {54a36939-01eb-4a89-85bd-744ae18598ae} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048810 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: test/wqr/mplvrnzwhwkvzmdzxlgouoicspnyx, hash key: 8fc54405d511604af20050b8ce1200cf, file_offset_of_buffer_end: 0, read_until_position: 60, internal buffer end: 60, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 54a36939-01eb-4a89-85bd-744ae18598ae:2376, file segment info: File segment: [0, 59], key: 8fc54405d511604af20050b8ce1200cf, state: DOWNLOADING, downloaded size: 0, reserved size: 60, downloader id: 54a36939-01eb-4a89-85bd-744ae18598ae:2376, current write offset: 0, caller id: 54a36939-01eb-4a89-85bd-744ae18598ae:2376, kind: Regular, unbound: 0: (while reading column type): (while reading from part /var/lib/clickhouse/disks/s3/store/6e4/6e4fe0b1-5b27-4b1d-845a-88e783da8be0/202410_1_49_8/ in table system.query_log (6e4fe0b1-5b27-4b1d-845a-88e783da8be0) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8022): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38588) (comment: 02765_queries_with_subqueries_profile_events.sh) (in query: SELECT 1 CSE_Multi, 0 allow_experimental_analyzer, ProfileEvents['InsertQuery'] InsertQuery, ProfileEvents['SelectQuery'] SelectQuery, ProfileEvents['InsertQueriesWithSubqueries'] InsertQueriesWithSubqueries, ProfileEvents['SelectQueriesWithSubqueries'] SelectQueriesWithSubqueries, ProfileEvents['QueriesWithSubqueries'] QueriesWithSubqueries FROM system.query_log WHERE current_database = currentDatabase() AND type = 'QueryFinish' AND query_id = 'pfffpjpvmg' FORMAT TSVWithNames;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 5. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 17. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec784a9 in /usr/bin/clickhouse 18. ./build_docker/./src/IO/ReadBuffer.h:72: DB::MergeTreeMarksLoader::loadMarksImpl() @ 0x00000000343aece8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::MergeTreeMarksLoader::loadMarks() @ 0x00000000343ac8a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/threadPoolCallbackRunner.h:43: std::__packaged_task_func> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'(), std::allocator> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'()>, std::shared_ptr ()>::operator()() @ 0x00000000343b2cba in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task ()>::operator()() @ 0x00000000343b7f6c in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:38.385718 [ 11880 ] {54a36939-01eb-4a89-85bd-744ae18598ae} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048810 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: test/wqr/mplvrnzwhwkvzmdzxlgouoicspnyx, hash key: 8fc54405d511604af20050b8ce1200cf, file_offset_of_buffer_end: 0, read_until_position: 60, internal buffer end: 60, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 54a36939-01eb-4a89-85bd-744ae18598ae:2376, file segment info: File segment: [0, 59], key: 8fc54405d511604af20050b8ce1200cf, state: DOWNLOADING, downloaded size: 0, reserved size: 60, downloader id: 54a36939-01eb-4a89-85bd-744ae18598ae:2376, current write offset: 0, caller id: 54a36939-01eb-4a89-85bd-744ae18598ae:2376, kind: Regular, unbound: 0: (while reading column type): (while reading from part /var/lib/clickhouse/disks/s3/store/6e4/6e4fe0b1-5b27-4b1d-845a-88e783da8be0/202410_1_49_8/ in table system.query_log (6e4fe0b1-5b27-4b1d-845a-88e783da8be0) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8022): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 5. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 17. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec784a9 in /usr/bin/clickhouse 18. ./build_docker/./src/IO/ReadBuffer.h:72: DB::MergeTreeMarksLoader::loadMarksImpl() @ 0x00000000343aece8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::MergeTreeMarksLoader::loadMarks() @ 0x00000000343ac8a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/threadPoolCallbackRunner.h:43: std::__packaged_task_func> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'(), std::allocator> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'()>, std::shared_ptr ()>::operator()() @ 0x00000000343b2cba in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task ()>::operator()() @ 0x00000000343b7f6c in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:38.403052 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpa00b15f2-4938-4534-9785-979b6f85585d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.414982 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.426203 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd35999c3-ab64-47c8-bfbe-5d3f54ea6bf2' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.431226 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.469626 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp6095697b-e9c5-4150-bec4-dabdb747a6fc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.470176 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp7d750db0-4f1b-4e8d-b140-5a4ee9a08ed7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.515279 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.571895 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.637394 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp6f4da919-11c9-4c25-8136-69889cca9c93' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.637523 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp9bde0937-52d3-47bc-b124-ebecdc47c056' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.640517 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.642436 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.661455 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_54_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1185823 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.662293 [ 11408 ] {6bfc16bc-b5ff-42f9-916a-fafbcdbe3455} executeQuery: Code: 107. DB::Exception: File /var/lib/clickhouse/store/8b4/8b4ae3aa-dc10-47eb-afab-8b10ba0d783c//data.Parquet doesn't exist. (FILE_DOESNT_EXIST) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38802) (comment: 00163_column_oriented_formats.sh) (in query: SELECT MobilePhoneModel from 00163_column_oriented), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032e790ee in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/IStorage.cpp:144: DB::IStorage::read(DB::QueryPlan&, std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032cc21d9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:2486: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000031538d65 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031526e5b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:38.667413 [ 11408 ] {6bfc16bc-b5ff-42f9-916a-fafbcdbe3455} TCPHandler: Code: 107. DB::Exception: File /var/lib/clickhouse/store/8b4/8b4ae3aa-dc10-47eb-afab-8b10ba0d783c//data.Parquet doesn't exist. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032e790ee in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/IStorage.cpp:144: DB::IStorage::read(DB::QueryPlan&, std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032cc21d9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:2486: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000031538d65 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031526e5b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:38.672862 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp2e5877b0-a381-449a-af33-e449f3a6bf2c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.706849 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.710682 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmpc62ba90c-e8c6-4245-8111-d0cb4a856da2' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.753940 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.778725 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc8b84399-f89b-4f60-a44f-621e864f88b1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.780327 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp94c7f0b9-b0c8-4700-8e3c-4df46260e6f8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.783940 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.783920 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.822480 [ 2068 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.822569 [ 2080 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.824731 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp12c970a7-a2cb-4ccd-827e-64f78e0b421b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.832565 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.833148 [ 2089 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.835774 [ 2187 ] {} 8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.837500 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8691f091-0349-4ac6-aaab-2a21a1569f50::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.855921 [ 3737 ] {62c33cda-739c-4bec-aaf3-0a29865adc64} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38810) (comment: 02129_add_column_add_ttl.sql) (in query: CREATE TABLE ttl_test_02129 (`a` Int64, `b` String, `d` Date) ENGINE = MergeTree PARTITION BY d ORDER BY a SETTINGS min_bytes_for_wide_part = 0, min_rows_for_wide_part = 0, materialize_ttl_recalculate_only = 0, index_granularity = 51459, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 2566, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 10471726866, index_granularity_bytes = 18505466, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 9512, primary_key_compress_block_size = 26265), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:33:38.883211 [ 3737 ] {62c33cda-739c-4bec-aaf3-0a29865adc64} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:33:38.933671 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7da12d27-49df-47cf-9fc4-3b5a354dc7db' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:38.938770 [ 2012 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.939429 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.939482 [ 2078 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:38.939962 [ 2007 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:39.048288 [ 11887 ] {9bf8152c-dbd1-4a88-afd2-086b1d4c91bc} executeQuery: Code: 107. DB::Exception: File /var/lib/clickhouse/store/8b4/8b4ae3aa-dc10-47eb-afab-8b10ba0d783c//data.Parquet doesn't exist. (FILE_DOESNT_EXIST) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57680) (comment: 00163_column_oriented_formats.sh) (in query: SELECT ClientIP6 from 00163_column_oriented), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032e790ee in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/IStorage.cpp:144: DB::IStorage::read(DB::QueryPlan&, std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032cc21d9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:2486: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000031538d65 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031526e5b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:39.056320 [ 11887 ] {9bf8152c-dbd1-4a88-afd2-086b1d4c91bc} TCPHandler: Code: 107. DB::Exception: File /var/lib/clickhouse/store/8b4/8b4ae3aa-dc10-47eb-afab-8b10ba0d783c//data.Parquet doesn't exist. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageFile.cpp:1434: DB::StorageFile::read(std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032e790ee in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/IStorage.cpp:144: DB::IStorage::read(DB::QueryPlan&, std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032cc21d9 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:2486: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000031538d65 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031526e5b in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:39.491359 [ 11408 ] {2e3f77a0-2d09-4fe1-8e8b-dcadd7cec7bd} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57682) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:39.653192 [ 11408 ] {2e3f77a0-2d09-4fe1-8e8b-dcadd7cec7bd} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:39.653209 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1114301 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:39.662534 [ 2184 ] {} e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1089810 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f2711e3 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 29. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:39.663048 [ 2198 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpa10a4330-28d1-44f5-8d8b-951bc00d269c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:39.664345 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {e419b2d7-0087-4452-b8b4-87d7d2dd1b74::all_0_5_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1089810 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 11. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f2711e3 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:188: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eb927 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 29. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:39.667643 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:39.685854 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:84: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b5bc in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:39.998532 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4495909 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:39.998556 [ 1992 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:39.998717 [ 2028 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:39.998658 [ 2092 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:39.998782 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e9011b in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 19. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:39.999175 [ 2044 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:39.999284 [ 2034 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:39.999833 [ 2032 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:40.122745 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_54_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:40.541716 [ 11864 ] {4c1d0208-7eb0-424b-8c5c-8735c9393434} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57748) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:40.554918 [ 11864 ] {4c1d0208-7eb0-424b-8c5c-8735c9393434} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:40.716491 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:40.937981 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_55_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1118460 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:40.949942 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:84: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b5bc in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:41.348591 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 4198715 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x00000000345c90ba in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c4485 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ac548 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c62f99 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c60a86 in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d962b79 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:41.348777 [ 1978 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:41.348918 [ 2008 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:41.349235 [ 2070 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:41.348965 [ 2079 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:41.348830 [ 1999 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:41.348597 [ 2093 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:41.622238 [ 11887 ] {809168a5-4d3e-49e0-a790-85a2dfba5c2f} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57770) (comment: 01055_minmax_index_compact_parts.sh) (in query: CREATE TABLE minmax_idx (`u64` UInt64, `i32` Int32, `f64` Float64, `d` Decimal(10, 2), `s` String, `e` Enum8('a' = 1, 'b' = 2, 'c' = 3), `dt` Date, INDEX idx_all (i32, i32 + f64, d, s, e, dt) TYPE minmax GRANULARITY 1, INDEX idx_all2 (i32, i32 + f64, d, s, e, dt) TYPE minmax GRANULARITY 2, INDEX idx_2 (u64 + toYear(dt), substring(s, 2, 4)) TYPE minmax GRANULARITY 3) ENGINE = MergeTree ORDER BY u64 SETTINGS index_granularity = 2, index_granularity_bytes = '10Mi', min_rows_for_wide_part = 1000000, min_bytes_for_wide_part = 410745286, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 7292, prefer_fetch_merged_part_size_threshold = 1, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 17, min_merge_bytes_to_use_direct_io = 1, allow_vertical_merges_from_compact_to_wide_parts = true, marks_compress_block_size = 97767, primary_key_compress_block_size = 25279), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:33:41.967495 [ 11408 ] {ae015a39-9370-46e6-ac8e-ce35c264a057} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: while executing 'FUNCTION toString(number :: 0) -> toString(number) String : 1'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57786) (comment: 02151_http_s_structure_set_eof.sh) (in query: SELECT toString(number) FROM numbers(10e6) FORMAT TSV), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. DB::WriteBufferFromVector, 63ul, 64ul>>::nextImpl() @ 0x000000000bdcb4d0 in /usr/bin/clickhouse 11. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000bdd68e8 in /usr/bin/clickhouse 12. void DB::detail::writeUIntTextFallback(unsigned long, DB::WriteBuffer&) @ 0x000000000bdd938c in /usr/bin/clickhouse 13. DB::ConvertImpl, DB::DataTypeString, DB::NameToString, DB::ConvertDefaultBehaviorTag>::execute(std::vector> const&, std::shared_ptr const&, unsigned long) @ 0x000000000c69ada4 in /usr/bin/clickhouse 14. bool DB::callOnIndexAndDataType::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c690fa1 in /usr/bin/clickhouse 15. DB::FunctionConvert::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c68e793 in /usr/bin/clickhouse 16. DB::FunctionConvert::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c68c52a in /usr/bin/clickhouse 17. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 19. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 20. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 2024.10.22 00:33:41.998066 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4733473 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:41.998201 [ 3737 ] {f5ee6236-1942-4668-abf2-fc3781897b35} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 2097215 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: Cache info: Buffer path: common/mzb/lgcsczijcdyixywgzarpnruzovfis, hash key: 85ec2b5df9fe44881e77a58f1fc0617d, file_offset_of_buffer_end: 0, read_until_position: 342629, internal buffer end: 342629, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: f5ee6236-1942-4668-abf2-fc3781897b35:14562, file segment info: File segment: [0, 342628], key: 85ec2b5df9fe44881e77a58f1fc0617d, state: DOWNLOADING, downloaded size: 0, reserved size: 342629, downloader id: f5ee6236-1942-4668-abf2-fc3781897b35:14562, current write offset: 0, caller id: f5ee6236-1942-4668-abf2-fc3781897b35:14562, kind: Regular, unbound: 0: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_23_23_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57788) (comment: 00163_column_oriented_formats.sh) (in query: INSERT INTO 00163_column_oriented SELECT ClientEventTime, MobilePhoneModel, ClientIP6 FROM test.hits ORDER BY ClientEventTime, MobilePhoneModel, ClientIP6 LIMIT 100), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 19. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x000000002ec749b2 in /usr/bin/clickhouse 20. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec795a1 in /usr/bin/clickhouse 21. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:101: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f1aa586 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 2024.10.22 00:33:41.998260 [ 11874 ] {74791df3-fe96-4303-b684-2af730a738db} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57820) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:41.998524 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1709393 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_22_22_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:41.998394 [ 11887 ] {809168a5-4d3e-49e0-a790-85a2dfba5c2f} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 2024.10.22 00:33:42.135748 [ 11408 ] {ae015a39-9370-46e6-ac8e-ce35c264a057} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: while executing 'FUNCTION toString(number :: 0) -> toString(number) String : 1'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. DB::WriteBufferFromVector, 63ul, 64ul>>::nextImpl() @ 0x000000000bdcb4d0 in /usr/bin/clickhouse 11. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000bdd68e8 in /usr/bin/clickhouse 12. void DB::detail::writeUIntTextFallback(unsigned long, DB::WriteBuffer&) @ 0x000000000bdd938c in /usr/bin/clickhouse 13. DB::ConvertImpl, DB::DataTypeString, DB::NameToString, DB::ConvertDefaultBehaviorTag>::execute(std::vector> const&, std::shared_ptr const&, unsigned long) @ 0x000000000c69ada4 in /usr/bin/clickhouse 14. bool DB::callOnIndexAndDataType::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c690fa1 in /usr/bin/clickhouse 15. DB::FunctionConvert::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c68e793 in /usr/bin/clickhouse 16. DB::FunctionConvert::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c68c52a in /usr/bin/clickhouse 17. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 19. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 20. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 2024.10.22 00:33:42.136009 [ 11874 ] {74791df3-fe96-4303-b684-2af730a738db} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:42.177839 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1062170 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_9_9_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:42.220841 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_55_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1098904 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/6e4/6e4fe0b1-5b27-4b1d-845a-88e783da8be0/202410_53_53_0/ in table system.query_log (6e4fe0b1-5b27-4b1d-845a-88e783da8be0) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 298): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray, 63ul, 64ul>&, DB::PODArray, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x000000002f2832c7 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27dda3 in /usr/bin/clickhouse 12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW::immutable_ptr&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional>) @ 0x0000000034413473 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderCompact.cpp:234: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x0000000034411539 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:42.228637 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:84: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b5bc in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:42.271331 [ 3737 ] {f5ee6236-1942-4668-abf2-fc3781897b35} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 2097215 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: Cache info: Buffer path: common/mzb/lgcsczijcdyixywgzarpnruzovfis, hash key: 85ec2b5df9fe44881e77a58f1fc0617d, file_offset_of_buffer_end: 0, read_until_position: 342629, internal buffer end: 342629, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: f5ee6236-1942-4668-abf2-fc3781897b35:14562, file segment info: File segment: [0, 342628], key: 85ec2b5df9fe44881e77a58f1fc0617d, state: DOWNLOADING, downloaded size: 0, reserved size: 342629, downloader id: f5ee6236-1942-4668-abf2-fc3781897b35:14562, current write offset: 0, caller id: f5ee6236-1942-4668-abf2-fc3781897b35:14562, kind: Regular, unbound: 0: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_23_23_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 19. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x000000002ec749b2 in /usr/bin/clickhouse 20. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec795a1 in /usr/bin/clickhouse 21. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:101: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f1aa586 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 2024.10.22 00:33:42.351109 [ 2059 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:42.351939 [ 2029 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:42.352150 [ 2100 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:42.352493 [ 1980 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:42.353530 [ 2086 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:42.354160 [ 2019 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:42.621347 [ 11864 ] {82a3b8c9-db9c-4de5-a344-fce68e165e34} executeQuery: Code: 60. DB::Exception: Table test_3.minmax_idx does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57846) (comment: 01055_minmax_index_compact_parts.sh) (in query: INSERT INTO minmax_idx VALUES ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:42.631972 [ 11864 ] {82a3b8c9-db9c-4de5-a344-fce68e165e34} TCPHandler: Code: 60. DB::Exception: Table test_3.minmax_idx does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:42.827474 [ 3737 ] {b2c8143b-a084-435f-b9c0-65ebaed5b74c} executeQuery: Code: 36. DB::Exception: Expected two string literal arguments: zookeeper_path and replica_name. (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57850) (comment: 01512_create_replicate_merge_tree_one_arg.sql) (in query: CREATE TABLE mt (`v` UInt8) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{database}/test_01497/mt') ORDER BY tuple() SETTINGS index_granularity = 24998, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 5371, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 774590, vertical_merge_algorithm_min_columns_to_activate = 91, min_merge_bytes_to_use_direct_io = 8590087642, index_granularity_bytes = 14947179, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 89074, primary_key_compress_block_size = 39846), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [71]) @ 0x00000000279e3409 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/registerStorageMergeTree.cpp:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348efcd9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:42.842166 [ 3737 ] {b2c8143b-a084-435f-b9c0-65ebaed5b74c} TCPHandler: Code: 36. DB::Exception: Expected two string literal arguments: zookeeper_path and replica_name. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [71]) @ 0x00000000279e3409 in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/MergeTree/registerStorageMergeTree.cpp:0: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348efcd9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:42.901844 [ 11886 ] {556a54a6-dd1e-4a66-bc2d-118adbf2d68e} executeQuery: Code: 24. DB::Exception: Cannot write to ostream at offset 2: While executing ParallelFormattingOutputFormat. (CANNOT_WRITE_TO_OSTREAM) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:33394) (comment: 02151_http_s_structure_set_eof.sh) (in query: SELECT dummy IN s), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&&) @ 0x00000000102d6c67 in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromOStream.cpp:22: DB::WriteBufferFromOStream::nextImpl() @ 0x000000001da71646 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x0000000034f4277a in /usr/bin/clickhouse 5. ./build_docker/./src/IO/WriteBuffer.h:60: DB::IOutputFormat::flush() @ 0x000000003503f218 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Formats/Impl/ParallelFormattingOutputFormat.cpp:0: DB::ParallelFormattingOutputFormat::collectorThreadFunction(std::shared_ptr const&) @ 0x0000000035459cb6 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Formats/Impl/ParallelFormattingOutputFormat.h:0: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::ParallelFormattingOutputFormat::ParallelFormattingOutputFormat(DB::ParallelFormattingOutputFormat::Params)::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000034f75429 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:42.931817 [ 11886 ] {556a54a6-dd1e-4a66-bc2d-118adbf2d68e} DynamicQueryHandler: Code: 24. DB::Exception: Cannot write to ostream at offset 2: While executing ParallelFormattingOutputFormat. (CANNOT_WRITE_TO_OSTREAM), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&&) @ 0x00000000102d6c67 in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromOStream.cpp:22: DB::WriteBufferFromOStream::nextImpl() @ 0x000000001da71646 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x0000000034f4277a in /usr/bin/clickhouse 5. ./build_docker/./src/IO/WriteBuffer.h:60: DB::IOutputFormat::flush() @ 0x000000003503f218 in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Formats/Impl/ParallelFormattingOutputFormat.cpp:0: DB::ParallelFormattingOutputFormat::collectorThreadFunction(std::shared_ptr const&) @ 0x0000000035459cb6 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Formats/Impl/ParallelFormattingOutputFormat.h:0: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::ParallelFormattingOutputFormat::ParallelFormattingOutputFormat(DB::ParallelFormattingOutputFormat::Params)::'lambda'()&&)::'lambda'()::operator()() @ 0x0000000034f75429 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:42.962535 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1062270 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column EventDate): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_19_19_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a5a2 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:42.962872 [ 11886 ] {556a54a6-dd1e-4a66-bc2d-118adbf2d68e} DynamicQueryHandler: Cannot send exception to client: Code: 24. DB::Exception: Cannot write to ostream at offset 191. (CANNOT_WRITE_TO_OSTREAM), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&&) @ 0x00000000102d6c67 in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromOStream.cpp:22: DB::WriteBufferFromOStream::nextImpl() @ 0x000000001da71646 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x0000000034f4277a in /usr/bin/clickhouse 5. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x0000000034dd542f in /usr/bin/clickhouse 6. ./build_docker/./src/Server/HTTPHandler.cpp:0: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034ddc95c in /usr/bin/clickhouse 7. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.010657 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 5160832 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.011016 [ 11886 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:0: Poco::Net::HTTPChunkedStreamBuf::writeToDevice(char const*, long) @ 0x000000003dc03639 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:130: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::sync() @ 0x000000003db4eff9 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:55: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f2b in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.034439 [ 11864 ] {34997bda-0a77-4e07-9539-5dcfab258799} executeQuery: Code: 60. DB::Exception: Table test_3.minmax_idx does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57880) (comment: 01055_minmax_index_compact_parts.sh) (in query: SELECT * FROM minmax_idx WHERE i32 = 5 AND i32 + f64 < 12 AND 3 < d AND d < 7 AND (s = 'bac' OR s = 'cba') ORDER BY dt), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:43.055489 [ 3737 ] {a879e900-7b3b-4cbe-b510-ccec239b8aed} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57872) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:43.078656 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_55_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1090741 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/6e4/6e4fe0b1-5b27-4b1d-845a-88e783da8be0/202410_51_51_0/ in table system.query_log (6e4fe0b1-5b27-4b1d-845a-88e783da8be0) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 320): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray, 63ul, 64ul>&, DB::PODArray, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x000000002f2832c7 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27dda3 in /usr/bin/clickhouse 12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW::immutable_ptr&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional>) @ 0x0000000034413473 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderCompact.cpp:234: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x0000000034411539 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.225461 [ 3737 ] {a879e900-7b3b-4cbe-b510-ccec239b8aed} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:43.226684 [ 11864 ] {34997bda-0a77-4e07-9539-5dcfab258799} TCPHandler: Code: 60. DB::Exception: Table test_3.minmax_idx does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:43.374813 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:84: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b5bc in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.375031 [ 11408 ] {be00600c-ac99-40ee-90fc-692679c82707} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing ParallelFormattingOutputFormat. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:33396) (comment: 02151_http_s_structure_set_eof.sh) (in query: SELECT dummy IN s), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ParallelFormattingOutputFormat::formatterThreadFunction(unsigned long, unsigned long, std::shared_ptr const&) @ 0x000000003545a796 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 11. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:43.375661 [ 2078 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.375706 [ 2081 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.375896 [ 2016 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.375637 [ 2007 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.375948 [ 2000 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.376098 [ 2045 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.386044 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_55_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1209247 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.387466 [ 11408 ] {be00600c-ac99-40ee-90fc-692679c82707} DynamicQueryHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing ParallelFormattingOutputFormat. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ParallelFormattingOutputFormat::formatterThreadFunction(unsigned long, unsigned long, std::shared_ptr const&) @ 0x000000003545a796 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 11. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.389443 [ 11408 ] {be00600c-ac99-40ee-90fc-692679c82707} DynamicQueryHandler: Cannot send exception to client: Code: 24. DB::Exception: Cannot write to ostream at offset 346. (CANNOT_WRITE_TO_OSTREAM), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, unsigned long&&) @ 0x00000000102d6c67 in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromOStream.cpp:22: DB::WriteBufferFromOStream::nextImpl() @ 0x000000001da71646 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x0000000034f4277a in /usr/bin/clickhouse 5. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x0000000034dd542f in /usr/bin/clickhouse 6. ./build_docker/./src/Server/HTTPHandler.cpp:0: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000034ddc95c in /usr/bin/clickhouse 7. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x0000000034f324b0 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 12. ? @ 0x00007f11b339dac3 in ? 13. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.400263 [ 11408 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 32, I/O error: Broken pipe, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9d601 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::sendBytes(void const*, int, int) @ 0x000000003dca29e8 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/StreamSocketImpl.cpp:63: Poco::Net::StreamSocketImpl::sendBytes(void const*, int, int) @ 0x000000003dcb3a69 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:144: Poco::Net::HTTPSession::write(char const*, long) @ 0x000000003dc4bef8 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:0: Poco::Net::HTTPChunkedStreamBuf::writeToDevice(char const*, long) @ 0x000000003dc03639 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:130: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::sync() @ 0x000000003db4eff9 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:55: Poco::Net::HTTPChunkedIOS::~HTTPChunkedIOS() @ 0x000000003dc03f2b in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/HTTPChunkedStream.cpp:207: Poco::Net::HTTPChunkedOutputStream::~HTTPChunkedOutputStream() @ 0x000000003dc0510b in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:216: DB::HTTPServerConnection::run() @ 0x0000000034f32794 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.418726 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4270682 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.501314 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1097490 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_9_9_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 1 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89205 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f218266 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 29. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.539633 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpcb312498-e078-41ee-ac62-07e2710f714d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:43.541860 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpbb433ade-ac2d-42ef-9a99-80de9afb3d2e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:43.547236 [ 11862 ] {34e6c85d-0771-4ee1-bdc0-86de1d7b5cfe} executeQuery: Code: 36. DB::Exception: Frame start offset for 'RANGE' frame must be a nonnegative 32-bit integer, '0.' of type 'Float64' given. (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57896) (comment: 02833_window_func_range_offset.sql) (in query: -- invalid start offset with RANGE SELECT count() OVER (ORDER BY 3.4028234663852886e38 RANGE BETWEEN 0.0 PRECEDING AND UNBOUNDED FOLLOWING);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, DB::WindowFrame::FrameType const&, String&&, DB::Field::Types::Which&&) @ 0x0000000031fe43e2 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/WindowDescription.cpp:100: DB::WindowFrame::checkValid() const @ 0x0000000031fe3013 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/WindowDescription.cpp:197: DB::WindowDescription::checkValid() const @ 0x0000000031fe3825 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/QueryPlan/WindowStep.cpp:0: DB::WindowStep::WindowStep(DB::DataStream const&, DB::WindowDescription const&, std::vector> const&) @ 0x0000000035ddd3a7 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::InterpreterSelectQuery::executeWindow(DB::QueryPlan&) @ 0x0000000031545361 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x00000000315295c9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:43.554812 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 5075676 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.556526 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.559616 [ 11862 ] {34e6c85d-0771-4ee1-bdc0-86de1d7b5cfe} TCPHandler: Code: 36. DB::Exception: Frame start offset for 'RANGE' frame must be a nonnegative 32-bit integer, '0.' of type 'Float64' given. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, DB::WindowFrame::FrameType const&, String&&, DB::Field::Types::Which&&) @ 0x0000000031fe43e2 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/WindowDescription.cpp:100: DB::WindowFrame::checkValid() const @ 0x0000000031fe3013 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/WindowDescription.cpp:197: DB::WindowDescription::checkValid() const @ 0x0000000031fe3825 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/QueryPlan/WindowStep.cpp:0: DB::WindowStep::WindowStep(DB::DataStream const&, DB::WindowDescription const&, std::vector> const&) @ 0x0000000035ddd3a7 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::InterpreterSelectQuery::executeWindow(DB::QueryPlan&) @ 0x0000000031545361 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x00000000315295c9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:43.567581 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.613893 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc92700cf-061a-415e-b962-f93b83832840' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:43.617426 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp3d319a6e-a80c-4711-adbd-d8ef75989b91' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:43.617450 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.645809 [ 11887 ] {cb5f37f1-1205-48f5-9674-54c79c8b7a9e} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing Remote. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57870) (comment: 01932_remote_sharding_key_column.sql) (in query: -- regression test for the following query: -- -- select * from remote('127.1', system.one, dummy) -- -- that produce the following error before: -- -- Unknown column: dummy, there are only columns . -- -- NOTE: that wrapping column into any function works before. select * from remote('127.1', system.one, dummy) format Null;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/FiberStack.h:60: FiberStack::allocate() const @ 0x000000002edcdeaf in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:312: boost::context::detail::fiber_activation_record* boost::context::detail::create_fiber1>(FiberStack&, Fiber::RoutineImpl&&) @ 0x000000002edcc28e in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:449: DB::AsyncTaskExecutor::createFiber() @ 0x000000002edcaee3 in /usr/bin/clickhouse 11. ./build_docker/./src/Common/AsyncTaskExecutor.cpp:21: DB::AsyncTaskExecutor::resume() @ 0x000000002edcab75 in /usr/bin/clickhouse 12. ./build_docker/./src/Client/HedgedConnections.cpp:0: DB::HedgedConnections::resumePacketReceiver(DB::HedgedConnections::ReplicaLocation const&) @ 0x0000000034c6a2e5 in /usr/bin/clickhouse 13. ./build_docker/./src/Client/HedgedConnections.cpp:331: DB::HedgedConnections::getReadyReplicaLocation(std::function) @ 0x0000000034c68a9f in /usr/bin/clickhouse 14. ./build_docker/./src/Client/HedgedConnections.cpp:0: DB::HedgedConnections::receivePacketUnlocked(std::function) @ 0x0000000034c69d68 in /usr/bin/clickhouse 15. ./build_docker/./src/QueryPipeline/RemoteQueryExecutorReadContext.cpp:0: DB::RemoteQueryExecutorReadContext::Task::run(std::function, std::function) @ 0x000000002edd1fc4 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x000000002edcf826 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: boost::context::detail::fiber_capture_record>::run() @ 0x000000002edcec1f in /usr/bin/clickhouse 18. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func>>(unsigned int, unsigned int) @ 0x000000002edcc7d4 in /usr/bin/clickhouse 2024.10.22 00:33:43.650730 [ 11862 ] {e4bff004-06f8-4718-880d-7e2be05d50fa} executeQuery: Code: 36. DB::Exception: Frame start offset for 'RANGE' frame must be a nonnegative 32-bit integer, 'nan' of type 'Float64' given. (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57896) (comment: 02833_window_func_range_offset.sql) (in query: SELECT count() OVER (ORDER BY 3.4028234663852886e38 RANGE BETWEEN nan PRECEDING AND UNBOUNDED FOLLOWING);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, DB::WindowFrame::FrameType const&, String&&, DB::Field::Types::Which&&) @ 0x0000000031fe43e2 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/WindowDescription.cpp:100: DB::WindowFrame::checkValid() const @ 0x0000000031fe3013 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/WindowDescription.cpp:197: DB::WindowDescription::checkValid() const @ 0x0000000031fe3825 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/QueryPlan/WindowStep.cpp:0: DB::WindowStep::WindowStep(DB::DataStream const&, DB::WindowDescription const&, std::vector> const&) @ 0x0000000035ddd3a7 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::InterpreterSelectQuery::executeWindow(DB::QueryPlan&) @ 0x0000000031545361 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x00000000315295c9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:43.650937 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.655880 [ 11874 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:48532). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000001dd67cf6 in /usr/bin/clickhouse 3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000001dd66139 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x0000000034ed576e in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.656090 [ 11862 ] {e4bff004-06f8-4718-880d-7e2be05d50fa} TCPHandler: Code: 36. DB::Exception: Frame start offset for 'RANGE' frame must be a nonnegative 32-bit integer, 'nan' of type 'Float64' given. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, DB::WindowFrame::FrameType const&, String&&, DB::Field::Types::Which&&) @ 0x0000000031fe43e2 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/WindowDescription.cpp:100: DB::WindowFrame::checkValid() const @ 0x0000000031fe3013 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/WindowDescription.cpp:197: DB::WindowDescription::checkValid() const @ 0x0000000031fe3825 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/QueryPlan/WindowStep.cpp:0: DB::WindowStep::WindowStep(DB::DataStream const&, DB::WindowDescription const&, std::vector> const&) @ 0x0000000035ddd3a7 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::InterpreterSelectQuery::executeWindow(DB::QueryPlan&) @ 0x0000000031545361 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x00000000315295c9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:43.657450 [ 11887 ] {cb5f37f1-1205-48f5-9674-54c79c8b7a9e} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing Remote. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/FiberStack.h:60: FiberStack::allocate() const @ 0x000000002edcdeaf in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:312: boost::context::detail::fiber_activation_record* boost::context::detail::create_fiber1>(FiberStack&, Fiber::RoutineImpl&&) @ 0x000000002edcc28e in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:449: DB::AsyncTaskExecutor::createFiber() @ 0x000000002edcaee3 in /usr/bin/clickhouse 11. ./build_docker/./src/Common/AsyncTaskExecutor.cpp:21: DB::AsyncTaskExecutor::resume() @ 0x000000002edcab75 in /usr/bin/clickhouse 12. ./build_docker/./src/Client/HedgedConnections.cpp:0: DB::HedgedConnections::resumePacketReceiver(DB::HedgedConnections::ReplicaLocation const&) @ 0x0000000034c6a2e5 in /usr/bin/clickhouse 13. ./build_docker/./src/Client/HedgedConnections.cpp:331: DB::HedgedConnections::getReadyReplicaLocation(std::function) @ 0x0000000034c68a9f in /usr/bin/clickhouse 14. ./build_docker/./src/Client/HedgedConnections.cpp:0: DB::HedgedConnections::receivePacketUnlocked(std::function) @ 0x0000000034c69d68 in /usr/bin/clickhouse 15. ./build_docker/./src/QueryPipeline/RemoteQueryExecutorReadContext.cpp:0: DB::RemoteQueryExecutorReadContext::Task::run(std::function, std::function) @ 0x000000002edd1fc4 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x000000002edcf826 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: boost::context::detail::fiber_capture_record>::run() @ 0x000000002edcec1f in /usr/bin/clickhouse 18. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func>>(unsigned int, unsigned int) @ 0x000000002edcc7d4 in /usr/bin/clickhouse 2024.10.22 00:33:43.702913 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5162551 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031cccb46 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d9693f9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.749570 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc99f711a-60ac-4d1b-ad35-268c94f35b02' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:43.749596 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp0780b1af-81fa-4050-b412-d78350de6a6c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:43.752161 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.757062 [ 3737 ] {a8e886e2-39e1-4f1e-977c-885e17fa2237} executeQuery: Code: 60. DB::Exception: Table test_3.minmax_idx does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57910) (comment: 01055_minmax_index_compact_parts.sh) (in query: SELECT * FROM minmax_idx WHERE i32 = 5 AND i32 + f64 < 12 AND 3 < d AND d < 7 AND (s = 'bac' OR s = 'cba') ORDER BY dt FORMAT JSON), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:43.760339 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.778215 [ 3737 ] {a8e886e2-39e1-4f1e-977c-885e17fa2237} TCPHandler: Code: 60. DB::Exception: Table test_3.minmax_idx does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:43.795373 [ 2307 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4204852 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long const*, unsigned long const*) @ 0x000000001d63315d in /usr/bin/clickhouse 8. ./build_docker/./src/Columns/ColumnString.cpp:32: DB::ColumnString::ColumnString(DB::ColumnString const&) @ 0x00000000326da21b in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper::clone() const @ 0x00000000326f2288 in /usr/bin/clickhouse 10. DB::IColumn::mutate(COW::immutable_ptr) @ 0x000000000cf55c03 in /usr/bin/clickhouse 11. void std::__invoke_void_return_wrapper::__call::immutable_ptr)::'lambda'(COW::chameleon_ptr&)&, COW::chameleon_ptr&>(DB::IColumn::mutate(COW::immutable_ptr)::'lambda'(COW::chameleon_ptr&)&, COW::chameleon_ptr&) @ 0x000000000cf5617b in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::ColumnTuple::forEachSubcolumn(std::function::chameleon_ptr&)>) @ 0x000000003275bc13 in /usr/bin/clickhouse 13. DB::IColumn::mutate(COW::immutable_ptr) @ 0x000000000cf55d4b in /usr/bin/clickhouse 14. void std::__invoke_void_return_wrapper::__call::immutable_ptr)::'lambda'(COW::chameleon_ptr&)&, COW::chameleon_ptr&>(DB::IColumn::mutate(COW::immutable_ptr)::'lambda'(COW::chameleon_ptr&)&, COW::chameleon_ptr&) @ 0x000000000cf5617b in /usr/bin/clickhouse 15. DB::IColumn::mutate(COW::immutable_ptr) @ 0x000000000cf55d4b in /usr/bin/clickhouse 16. ./build_docker/./src/Core/Block.cpp:470: DB::Block::mutateColumns() @ 0x000000002e6a0083 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x000000003415b994 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x00000000345c211c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345abb85 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ca0bd9 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c9e6c6 in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d966779 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.910115 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpcf6b9398-e704-4717-91b3-c3ec40cf20f1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:43.910617 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc543e08a-b339-4375-b5cc-6ae71506e354' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:43.913181 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:43.927252 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:44.074954 [ 2310 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5165633 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cbf959 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:44.075795 [ 11862 ] {239e1aaa-06f5-4211-a740-041711a1eeab} executeQuery: Code: 36. DB::Exception: Frame end offset for 'RANGE' frame must be a nonnegative 32-bit integer, '0.' of type 'Float64' given. (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57896) (comment: 02833_window_func_range_offset.sql) (in query: -- invalid end offset with RANGE SELECT count() OVER (ORDER BY 3.4028234663852886e38 RANGE BETWEEN UNBOUNDED PRECEDING AND 0.0 FOLLOWING);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, DB::WindowFrame::FrameType const&, String&&, DB::Field::Types::Which&&) @ 0x0000000031fe43e2 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/WindowDescription.cpp:113: DB::WindowFrame::checkValid() const @ 0x0000000031fe31a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/WindowDescription.cpp:197: DB::WindowDescription::checkValid() const @ 0x0000000031fe3825 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/QueryPlan/WindowStep.cpp:0: DB::WindowStep::WindowStep(DB::DataStream const&, DB::WindowDescription const&, std::vector> const&) @ 0x0000000035ddd3a7 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::InterpreterSelectQuery::executeWindow(DB::QueryPlan&) @ 0x0000000031545361 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x00000000315295c9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:44.080645 [ 11862 ] {239e1aaa-06f5-4211-a740-041711a1eeab} TCPHandler: Code: 36. DB::Exception: Frame end offset for 'RANGE' frame must be a nonnegative 32-bit integer, '0.' of type 'Float64' given. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, DB::WindowFrame::FrameType const&, String&&, DB::Field::Types::Which&&) @ 0x0000000031fe43e2 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/WindowDescription.cpp:113: DB::WindowFrame::checkValid() const @ 0x0000000031fe31a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/WindowDescription.cpp:197: DB::WindowDescription::checkValid() const @ 0x0000000031fe3825 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/QueryPlan/WindowStep.cpp:0: DB::WindowStep::WindowStep(DB::DataStream const&, DB::WindowDescription const&, std::vector> const&) @ 0x0000000035ddd3a7 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::InterpreterSelectQuery::executeWindow(DB::QueryPlan&) @ 0x0000000031545361 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x00000000315295c9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:44.183784 [ 11862 ] {901f65a1-0115-4495-ae13-4b5b03d39f28} executeQuery: Code: 36. DB::Exception: Frame end offset for 'RANGE' frame must be a nonnegative 32-bit integer, 'nan' of type 'Float64' given. (BAD_ARGUMENTS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57896) (comment: 02833_window_func_range_offset.sql) (in query: SELECT count() OVER (ORDER BY 3.4028234663852886e38 RANGE BETWEEN UNBOUNDED PRECEDING AND nan FOLLOWING);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, DB::WindowFrame::FrameType const&, String&&, DB::Field::Types::Which&&) @ 0x0000000031fe43e2 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/WindowDescription.cpp:113: DB::WindowFrame::checkValid() const @ 0x0000000031fe31a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/WindowDescription.cpp:197: DB::WindowDescription::checkValid() const @ 0x0000000031fe3825 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/QueryPlan/WindowStep.cpp:0: DB::WindowStep::WindowStep(DB::DataStream const&, DB::WindowDescription const&, std::vector> const&) @ 0x0000000035ddd3a7 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::InterpreterSelectQuery::executeWindow(DB::QueryPlan&) @ 0x0000000031545361 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x00000000315295c9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:44.186567 [ 11864 ] {07a2916e-f8c6-4acd-83c9-6087c14ca834} executeQuery: Code: 60. DB::Exception: Table test_3.minmax_idx does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57936) (comment: 01055_minmax_index_compact_parts.sh) (in query: SELECT * FROM minmax_idx WHERE (u64 < 2 OR u64 > 10) AND e != 'b' ORDER BY dt), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:44.188593 [ 11862 ] {901f65a1-0115-4495-ae13-4b5b03d39f28} TCPHandler: Code: 36. DB::Exception: Frame end offset for 'RANGE' frame must be a nonnegative 32-bit integer, 'nan' of type 'Float64' given. (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, DB::WindowFrame::FrameType const&, String&&, DB::Field::Types::Which&&) @ 0x0000000031fe43e2 in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/WindowDescription.cpp:113: DB::WindowFrame::checkValid() const @ 0x0000000031fe31a3 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/WindowDescription.cpp:197: DB::WindowDescription::checkValid() const @ 0x0000000031fe3825 in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/QueryPlan/WindowStep.cpp:0: DB::WindowStep::WindowStep(DB::DataStream const&, DB::WindowDescription const&, std::vector> const&) @ 0x0000000035ddd3a7 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::InterpreterSelectQuery::executeWindow(DB::QueryPlan&) @ 0x0000000031545361 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x00000000315295c9 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x00000000316e5f2f in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:44.197021 [ 11864 ] {07a2916e-f8c6-4acd-83c9-6087c14ca834} TCPHandler: Code: 60. DB::Exception: Table test_3.minmax_idx does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:44.244808 [ 11874 ] {f8f86bf7-6829-4dd4-b5c9-17a391fc53b3} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57940) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:44.258407 [ 11874 ] {f8f86bf7-6829-4dd4-b5c9-17a391fc53b3} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:44.382067 [ 2069 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:44.382225 [ 2084 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:44.382651 [ 2005 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:44.383917 [ 2101 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:44.384204 [ 1988 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:44.384438 [ 2048 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:44.621824 [ 11874 ] {ed0e0af0-d263-49b4-b24b-b53369e79c9d} executeQuery: Code: 60. DB::Exception: Table test_3.minmax_idx does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57964) (comment: 01055_minmax_index_compact_parts.sh) (in query: SELECT * FROM minmax_idx WHERE (u64 < 2 OR u64 > 10) AND e != 'b' ORDER BY dt FORMAT JSON), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:44.624092 [ 11874 ] {ed0e0af0-d263-49b4-b24b-b53369e79c9d} TCPHandler: Code: 60. DB::Exception: Table test_3.minmax_idx does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:45.295226 [ 11864 ] {051a6815-e7ab-46bd-b849-73e43d9cc8d9} executeQuery: Code: 60. DB::Exception: Table test_3.minmax_idx does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57990) (comment: 01055_minmax_index_compact_parts.sh) (in query: DROP TABLE minmax_idx), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:941: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb39eb2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116bf05 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:92: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000003116a56b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168302 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:45.346835 [ 11864 ] {051a6815-e7ab-46bd-b849-73e43d9cc8d9} TCPHandler: Code: 60. DB::Exception: Table test_3.minmax_idx does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:941: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb39eb2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116bf05 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:92: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000003116a56b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168302 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:45.376281 [ 11867 ] {ec2ca04f-9b46-4795-9e9c-1578c559c1cf} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:58008) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:45.383679 [ 1984 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:45.384174 [ 2004 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:45.384414 [ 2030 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:45.385654 [ 2004 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:45.385917 [ 2008 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:45.386377 [ 2070 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:45.391243 [ 11867 ] {ec2ca04f-9b46-4795-9e9c-1578c559c1cf} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:46.131027 [ 12137 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:46.275969 [ 2190 ] {} 8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:46.276192 [ 11867 ] {ca5cd938-8c49-42ef-b0f0-0699b8b7c84e} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 2097215 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/mzb/lgcsczijcdyixywgzarpnruzovfis, hash key: 85ec2b5df9fe44881e77a58f1fc0617d, file_offset_of_buffer_end: 0, read_until_position: 342629, internal buffer end: 342629, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: ca5cd938-8c49-42ef-b0f0-0699b8b7c84e:20475, file segment info: File segment: [0, 342628], key: 85ec2b5df9fe44881e77a58f1fc0617d, state: DOWNLOADING, downloaded size: 0, reserved size: 342629, downloader id: ca5cd938-8c49-42ef-b0f0-0699b8b7c84e:20475, current write offset: 0, caller id: ca5cd938-8c49-42ef-b0f0-0699b8b7c84e:20475, kind: Regular, unbound: 0: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_23_23_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:58038) (comment: 00163_column_oriented_formats.sh) (in query: INSERT INTO 00163_column_oriented SELECT ClientEventTime, MobilePhoneModel, ClientIP6 FROM test.hits ORDER BY ClientEventTime, MobilePhoneModel, ClientIP6 LIMIT 100), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 19. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x000000002ec749b2 in /usr/bin/clickhouse 20. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec795a1 in /usr/bin/clickhouse 21. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:101: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f1aa586 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 2024.10.22 00:33:46.276946 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {8894d414-f99f-426c-a354-90502a12ca87::all_0_5_1}: Poco::Exception. Code: 1000, e.code() = 104, Connection reset by peer, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::IOException::IOException(int) @ 0x000000003e08e86e in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Net/src/NetException.cpp:31: Poco::Net::ConnectionResetException::ConnectionResetException(int) @ 0x000000003dc80dae in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:989: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9ca33 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::receiveBytes(void*, int, int) @ 0x000000003dca3088 in /usr/bin/clickhouse 4. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:176: Poco::Net::HTTPSession::refill() @ 0x000000003dc4ba09 in /usr/bin/clickhouse 5. ./build_docker/./base/poco/Net/src/HTTPSession.cpp:107: Poco::Net::HTTPSession::get() @ 0x000000003dc4b8aa in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/HTTPHeaderStream.cpp:0: Poco::Net::HTTPHeaderStreamBuf::readFromDevice(char*, long) @ 0x000000003dc378d7 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Foundation/include/Poco/BufferedStreamBuf.h:97: Poco::BasicBufferedStreamBuf, Poco::BufferAllocator>::underflow() @ 0x000000003db4f1bb in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/streambuf:445: std::basic_streambuf>::uflow() @ 0x000000004653d575 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/istream:0: std::basic_istream>::get() @ 0x00000000465436c8 in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Net/src/HTTPResponse.cpp:236: Poco::Net::HTTPResponse::read(std::basic_istream>&) @ 0x000000003dc4491a in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/HTTPClientSession.cpp:321: Poco::Net::HTTPClientSession::receiveResponse(Poco::Net::HTTPResponse&) @ 0x000000003dc0e42c in /usr/bin/clickhouse 12. ./build_docker/./src/IO/HTTPCommon.cpp:384: DB::receiveResponse(Poco::Net::HTTPClientSession&, Poco::Net::HTTPRequest const&, Poco::Net::HTTPResponse&, bool) @ 0x000000001dcfa100 in /usr/bin/clickhouse 13. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::callImpl(std::shared_ptr>&, Poco::URI, Poco::Net::HTTPResponse&, String const&, bool) @ 0x000000002683e19f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:341: DB::detail::ReadWriteBufferFromHTTPBase>>::call(std::shared_ptr>&, Poco::Net::HTTPResponse&, String const&, bool, bool) @ 0x0000000026846b68 in /usr/bin/clickhouse 15. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::initialize() @ 0x00000000268441c4 in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:0: DB::detail::ReadWriteBufferFromHTTPBase>>::ReadWriteBufferFromHTTPBase(std::shared_ptr>, Poco::URI, Poco::Net::HTTPBasicCredentials const&, String const&, std::function>&)>, unsigned long, DB::ReadSettings const&, std::vector>, DB::RemoteHostFilter const*, bool, bool, bool, std::optional, Poco::Net::HTTPClientSession::ProxyConfig) @ 0x0000000026842f9d in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:926: DB::PooledReadWriteBufferFromHTTP::PooledReadWriteBufferFromHTTP(Poco::URI, String const&, std::function>&)>, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials const&, unsigned long, unsigned long, unsigned long) @ 0x0000000026820666 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000](Poco::URI&, String const&, std::nullptr_t&&, DB::ConnectionTimeouts const&, Poco::Net::HTTPBasicCredentials&, unsigned long long&&, int&&, unsigned long&&) @ 0x0000000033caf14a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/DataPartsExchange.cpp:521: DB::DataPartsExchange::Fetcher::fetchSelectedPart(std::shared_ptr const&, std::shared_ptr, String const&, String const&, String const&, String const&, int, DB::ConnectionTimeouts const&, String const&, String const&, String const&, std::shared_ptr, bool, String const&, std::optional*, bool, std::shared_ptr) @ 0x0000000033c88c6c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:4596: std::shared_ptr std::__function::__policy_invoker ()>::__call_impl const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool)::$_4, std::shared_ptr ()>>(std::__function::__policy_storage const*) @ 0x0000000033456d96 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x0000000033214a1e in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:1953: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000331ea054 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:155: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x00000000346eba35 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000346e8c1f in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:46.309362 [ 11870 ] {63fd8671-4a68-47bb-9aef-e4ca831e0901} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:58082) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:46.321232 [ 11870 ] {63fd8671-4a68-47bb-9aef-e4ca831e0901} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:46.385074 [ 2020 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:46.385443 [ 2050 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:46.387233 [ 1989 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:46.387650 [ 2050 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:46.388331 [ 2091 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:46.391238 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1096285 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/84f/84f788e2-4f4e-45fa-bf6b-97219cb78fa2/201403_6_6_0/ in table test.visits (84f788e2-4f4e-45fa-bf6b-97219cb78fa2) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6826): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec79c47 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f21ac50 in /usr/bin/clickhouse 12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:46.395976 [ 2095 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:46.490082 [ 11867 ] {ca5cd938-8c49-42ef-b0f0-0699b8b7c84e} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 2097215 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/mzb/lgcsczijcdyixywgzarpnruzovfis, hash key: 85ec2b5df9fe44881e77a58f1fc0617d, file_offset_of_buffer_end: 0, read_until_position: 342629, internal buffer end: 342629, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: ca5cd938-8c49-42ef-b0f0-0699b8b7c84e:20475, file segment info: File segment: [0, 342628], key: 85ec2b5df9fe44881e77a58f1fc0617d, state: DOWNLOADING, downloaded size: 0, reserved size: 342629, downloader id: ca5cd938-8c49-42ef-b0f0-0699b8b7c84e:20475, current write offset: 0, caller id: ca5cd938-8c49-42ef-b0f0-0699b8b7c84e:20475, kind: Regular, unbound: 0: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_23_23_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 19. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x000000002ec749b2 in /usr/bin/clickhouse 20. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec795a1 in /usr/bin/clickhouse 21. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:101: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f1aa586 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 2024.10.22 00:33:47.257573 [ 11862 ] {d7584121-2438-415d-a94e-52fe99e8ac40} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1130952 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57984) (comment: 00678_shard_funnel_window.sql) (in query: SELECT level, COUNT() FROM (SELECT uid, windowFunnel(3600)(toUInt32(its), action_code != '', action_code = '2') AS level FROM remote('127.0.0.{2,3}', currentDatabase(), remote_test) GROUP BY uid) GROUP BY level;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d53a447 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/HashTable/HashTable.h:582: HashTable, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>::resize(unsigned long, unsigned long) @ 0x0000000030113828 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/HashTable/HashTable.h:0: void DB::Aggregator::mergeStreamsImplCase, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>>, HashMapTable, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>>(DB::Arena*, DB::AggregationMethodString, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>>&, HashMapTable, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>&, char*, unsigned long, unsigned long, std::vector, 63ul, 64ul> const*, std::allocator, 63ul, 64ul> const*>> const&, std::vector> const&, DB::Arena*) const @ 0x000000003010e402 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/Aggregator.cpp:2905: void DB::Aggregator::mergeStreamsImpl, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>>, HashMapTable, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>>(DB::Block, DB::Arena*, DB::AggregationMethodString, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>>&, HashMapTable, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>&, char*, bool, DB::Arena*) const @ 0x000000002ffbd54a in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/Aggregator.cpp:3209: DB::Aggregator::mergeBlocks(std::list>&, bool) @ 0x000000002fdec49b in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Transforms/MergingAggregatedMemoryEfficientTransform.cpp:0: DB::MergingAggregatedBucketTransform::transform(DB::Chunk&) @ 0x0000000035834f42 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 20. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:47.439233 [ 11392 ] {b695a0bf-cabb-4dc8-8184-0c0381a2b997} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:58134) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:47.446434 [ 11862 ] {d7584121-2438-415d-a94e-52fe99e8ac40} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1130952 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d53a447 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/HashTable/HashTable.h:582: HashTable, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>::resize(unsigned long, unsigned long) @ 0x0000000030113828 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/HashTable/HashTable.h:0: void DB::Aggregator::mergeStreamsImplCase, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>>, HashMapTable, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>>(DB::Arena*, DB::AggregationMethodString, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>>&, HashMapTable, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>&, char*, unsigned long, unsigned long, std::vector, 63ul, 64ul> const*, std::allocator, 63ul, 64ul> const*>> const&, std::vector> const&, DB::Arena*) const @ 0x000000003010e402 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/Aggregator.cpp:2905: void DB::Aggregator::mergeStreamsImpl, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>>, HashMapTable, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>>(DB::Block, DB::Arena*, DB::AggregationMethodString, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>>&, HashMapTable, StringRefHash64, HashTableGrowerWithPrecalculation<8ul>, Allocator>&, char*, bool, DB::Arena*) const @ 0x000000002ffbd54a in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/Aggregator.cpp:3209: DB::Aggregator::mergeBlocks(std::list>&, bool) @ 0x000000002fdec49b in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Transforms/MergingAggregatedMemoryEfficientTransform.cpp:0: DB::MergingAggregatedBucketTransform::transform(DB::Chunk&) @ 0x0000000035834f42 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 20. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:47.495378 [ 2089 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:47.495486 [ 2083 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:47.495658 [ 2035 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:47.495786 [ 2012 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:47.495854 [ 2000 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:47.496100 [ 2007 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:47.496455 [ 11392 ] {b695a0bf-cabb-4dc8-8184-0c0381a2b997} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:47.495303 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4878976 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c62f99 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:47.532244 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 2097152 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedWriteBuffer::nextImpl() @ 0x000000002ec7b869 in /usr/bin/clickhouse 10. DB::WriteBuffer::write(char) @ 0x000000000c6c080c in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:188: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl>(DB::SortingQueueImpl&) @ 0x0000000035af8cc9 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::SortingQueueImpl, DB::SortingQueueImpl>&>(std::__variant_detail::__visitation::__variant::__value_visitor&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::SortingQueueImpl, DB::SortingQueueImpl>&) @ 0x0000000035a6e937 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/variant:637: DB::MergingSortedAlgorithm::merge() @ 0x0000000035a61456 in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform::work() @ 0x0000000031b27a83 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 27. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:47.554159 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1498358 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/84f/84f788e2-4f4e-45fa-bf6b-97219cb78fa2/201403_1_1_0/ in table test.visits (84f788e2-4f4e-45fa-bf6b-97219cb78fa2) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6682): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:47.603709 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 2097152 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedWriteBuffer::nextImpl() @ 0x000000002ec7b869 in /usr/bin/clickhouse 10. DB::WriteBuffer::write(char) @ 0x000000000c6c080c in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:188: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl>(DB::SortingQueueImpl&) @ 0x0000000035af8cc9 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::SortingQueueImpl, DB::SortingQueueImpl>&>(std::__variant_detail::__visitation::__variant::__value_visitor&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::SortingQueueImpl, DB::SortingQueueImpl>&) @ 0x0000000035a6e937 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/variant:637: DB::MergingSortedAlgorithm::merge() @ 0x0000000035a61456 in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform::work() @ 0x0000000031b27a83 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 27. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:48.155810 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1062170 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_9_9_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:48.158323 [ 2526 ] {e437fc6e-101f-4597-a45b-51cccbafbd58} executeQuery: Code: 60. DB::Exception: Table shard_1.data_01850 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:59160) (comment: 01850_dist_INSERT_preserve_error.sql) (in query: INSERT INTO data_01850 (key) VALUES), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:48.162946 [ 2217 ] {} test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef): Removing temporary directory /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/tmp_merge_201403_17_24_1/ 2024.10.22 00:33:48.163337 [ 2526 ] {e437fc6e-101f-4597-a45b-51cccbafbd58} TCPHandler: Code: 60. DB::Exception: Table shard_1.data_01850 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:48.164043 [ 2217 ] {} test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/tmp_merge_201403_17_24_1/ 2024.10.22 00:33:48.174179 [ 11841 ] {3803ed2f-6627-432a-9ee4-265b7100a890} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:43662) (comment: 02869_parallel_replicas_read_from_several.sql) (in query: SELECT count(), min(`k`), max(`k`), avg(`k`) FROM `test_b1hclenb`.`t1`), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:48.176854 [ 11841 ] {3803ed2f-6627-432a-9ee4-265b7100a890} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:48.232198 [ 11867 ] {7f01d4a9-446d-4807-836a-b07ac1275025} executeQuery: Code: 60. DB::Exception: Received from localhost:9000. DB::Exception: Table shard_1.data_01850 does not exist. Stack trace: 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? : Insertion status: Wrote 0 blocks and 0 rows on shard 0 replica 0, localhost:9000 (average 109 ms per block) Wrote 0 blocks and 0 rows on shard 0 replica 1, localhost:9000 (average 92 ms per block) . (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:58124) (comment: 01850_dist_INSERT_preserve_error.sql) (in query: insert into dist_01850 values ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x000000001d7167e4 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x0000000034c029ec in /usr/bin/clickhouse 4. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::receivePacket() @ 0x0000000034c17b8e in /usr/bin/clickhouse 5. ./build_docker/./src/QueryPipeline/RemoteInserter.cpp:61: DB::RemoteInserter::RemoteInserter(DB::Connection&, DB::ConnectionTimeouts const&, String const&, DB::Settings const&, DB::ClientInfo const&) @ 0x0000000033c0d34b in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Sinks/RemoteSink.h:0: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033c58391 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 11. ? @ 0x00007f11b339dac3 in ? 12. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:48.232617 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1355998 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_18_18_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:48.232834 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpbdca9ff9-e05f-4f58-a8af-5ddf256bbc1c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:48.243670 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:48.244749 [ 11867 ] {7f01d4a9-446d-4807-836a-b07ac1275025} TCPHandler: Code: 60. DB::Exception: Received from localhost:9000. DB::Exception: Table shard_1.data_01850 does not exist. Stack trace: 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? : Insertion status: Wrote 0 blocks and 0 rows on shard 0 replica 0, localhost:9000 (average 109 ms per block) Wrote 0 blocks and 0 rows on shard 0 replica 1, localhost:9000 (average 92 ms per block) . (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x000000001d7167e4 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x0000000034c029ec in /usr/bin/clickhouse 4. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::receivePacket() @ 0x0000000034c17b8e in /usr/bin/clickhouse 5. ./build_docker/./src/QueryPipeline/RemoteInserter.cpp:61: DB::RemoteInserter::RemoteInserter(DB::Connection&, DB::ConnectionTimeouts const&, String const&, DB::Settings const&, DB::ClientInfo const&) @ 0x0000000033c0d34b in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Sinks/RemoteSink.h:0: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033c58391 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 8. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 9. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 11. ? @ 0x00007f11b339dac3 in ? 12. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:48.251470 [ 11867 ] {} TCPHandler: Code: 101. DB::NetException: Unexpected packet Data received from client. (UNEXPECTED_PACKET_FROM_CLIENT), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, char const (&) [44]) @ 0x0000000034f1d2ee in /usr/bin/clickhouse 3. ./build_docker/./src/Server/TCPHandler.cpp:1848: DB::TCPHandler::receiveUnexpectedData(bool) @ 0x0000000034f0c848 in /usr/bin/clickhouse 4. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x0000000034eec3ef in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed58db in /usr/bin/clickhouse 6. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 10. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 11. ? @ 0x00007f11b339dac3 in ? 12. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:48.434123 [ 2192 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpb9415dff-be24-4cfa-ae8a-58c6ad517eb0' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:48.453104 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp27d90b7c-0321-44f3-85bb-f87e2e6ec403' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:48.453374 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp67df908b-a6c2-4c45-833c-78af6eb50c09' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:48.717881 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:48.718401 [ 1992 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:48.718483 [ 11395 ] {1b564a0a-1ec4-485e-bd43-e3f7b7235c56} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:37184) (comment: 02869_parallel_replicas_read_from_several.sql) (in query: SELECT count(), min(`k`), max(`k`), avg(`k`) FROM `test_b1hclenb`.`t1`), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:48.718692 [ 2034 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:48.718745 [ 2044 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:48.719369 [ 2046 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:48.719467 [ 2092 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:48.719476 [ 2032 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:48.720115 [ 2653 ] {79c198d7-019d-4a00-9ebb-d2b4783a8480} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:36636) (comment: 02869_parallel_replicas_read_from_several.sql) (in query: SELECT count(), min(`k`), max(`k`), avg(`k`) FROM `test_b1hclenb`.`t1`), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:48.720287 [ 3735 ] {bfaffb40-39cd-4f6d-b635-5d3a82549e4f} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:58204) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:48.756166 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:48.758211 [ 2653 ] {79c198d7-019d-4a00-9ebb-d2b4783a8480} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:48.758432 [ 11395 ] {1b564a0a-1ec4-485e-bd43-e3f7b7235c56} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:48.760038 [ 3735 ] {bfaffb40-39cd-4f6d-b635-5d3a82549e4f} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:48.902158 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:48.902339 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_55_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1051964 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::reserveForNextSize<>() @ 0x000000000bdcc744 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:322: DB::ColumnString::insert(DB::Field const&) @ 0x00000000326f2875 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::ColumnUnique::uniqueInsert(DB::Field const&) @ 0x000000002ee4454c in /usr/bin/clickhouse 12. ./build_docker/./src/Columns/ColumnLowCardinality.cpp:140: DB::ColumnLowCardinality::insert(DB::Field const&) @ 0x000000003261881d in /usr/bin/clickhouse 13. ./build_docker/./src/Columns/ColumnTuple.cpp:146: DB::ColumnTuple::insert(DB::Field const&) @ 0x0000000032755b0e in /usr/bin/clickhouse 14. ./build_docker/./src/Columns/ColumnArray.cpp:303: DB::ColumnArray::insert(DB::Field const&) @ 0x0000000032350852 in /usr/bin/clickhouse 15. ./build_docker/./src/Columns/ColumnMap.cpp:102: DB::ColumnMap::insert(DB::Field const&) @ 0x0000000032667538 in /usr/bin/clickhouse 16. ./build_docker/./src/Columns/IColumn.cpp:34: DB::IColumn::insertFrom(DB::IColumn const&, unsigned long) @ 0x0000000032bb77dd in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl>(DB::SortingQueueImpl&) @ 0x0000000035af6890 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::SortingQueueImpl, DB::SortingQueueImpl>&>(std::__variant_detail::__visitation::__variant::__value_visitor&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::SortingQueueImpl, DB::SortingQueueImpl>&) @ 0x0000000035a6e937 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/variant:637: DB::MergingSortedAlgorithm::merge() @ 0x0000000035a61456 in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform::work() @ 0x0000000031b27a83 in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:48.902611 [ 11877 ] {1f927a33-f55c-49d0-8398-76053584a5df} executeQuery: Code: 241. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. Stack trace: 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? : While executing Remote. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:47142) (comment: 02869_parallel_replicas_read_from_several.sql) (in query: SELECT count(), min(k), max(k), avg(k) FROM t1 SETTINGS allow_experimental_parallel_reading_from_replicas = 1, max_parallel_replicas = 3, prefer_localhost_replica = 0, use_hedged_requests=0, cluster_for_parallel_replicas='test_cluster_one_shard_three_replicas_localhost', parallel_replicas_single_task_marks_count_multiplier = 0.001;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x000000001d7167e4 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x0000000034c029ec in /usr/bin/clickhouse 4. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::receivePacket() @ 0x0000000034c17b8e in /usr/bin/clickhouse 5. ./build_docker/./src/Client/MultiplexedConnections.cpp:0: DB::MultiplexedConnections::receivePacketUnlocked(std::function) @ 0x0000000034cafdb6 in /usr/bin/clickhouse 6. ./build_docker/./src/QueryPipeline/RemoteQueryExecutorReadContext.cpp:0: DB::RemoteQueryExecutorReadContext::Task::run(std::function, std::function) @ 0x000000002edd1fc4 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x000000002edcf826 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: boost::context::detail::fiber_capture_record>::run() @ 0x000000002edcec1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func>>(unsigned int, unsigned int) @ 0x000000002edcc7d4 in /usr/bin/clickhouse 2024.10.22 00:33:48.912287 [ 11395 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:37184). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000001dd67cf6 in /usr/bin/clickhouse 3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000001dd66139 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/ReadBuffer.h:72: DB::TCPHandler::runImpl() @ 0x0000000034ed576e in /usr/bin/clickhouse 5. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:48.939677 [ 11877 ] {1f927a33-f55c-49d0-8398-76053584a5df} TCPHandler: Code: 241. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. Stack trace: 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? : While executing Remote. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x000000001d7167e4 in /usr/bin/clickhouse 3. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::Connection::receiveException() const @ 0x0000000034c029ec in /usr/bin/clickhouse 4. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::receivePacket() @ 0x0000000034c17b8e in /usr/bin/clickhouse 5. ./build_docker/./src/Client/MultiplexedConnections.cpp:0: DB::MultiplexedConnections::receivePacketUnlocked(std::function) @ 0x0000000034cafdb6 in /usr/bin/clickhouse 6. ./build_docker/./src/QueryPipeline/RemoteQueryExecutorReadContext.cpp:0: DB::RemoteQueryExecutorReadContext::Task::run(std::function, std::function) @ 0x000000002edd1fc4 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x000000002edcf826 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: boost::context::detail::fiber_capture_record>::run() @ 0x000000002edcec1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func>>(unsigned int, unsigned int) @ 0x000000002edcc7d4 in /usr/bin/clickhouse 2024.10.22 00:33:48.960494 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp5c099628-385a-4faa-b258-b5556d924001' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:48.968021 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.003273 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp4074e82b-f8c5-4ca8-82cf-ce8bd27535ea' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:49.014490 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.035344 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 5160832 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.058728 [ 11408 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.058812 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpbf3324c9-33e2-4599-b66c-d5ac6b14e623' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:49.061961 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp176d445f-3d67-418d-88a1-938e3fde65be' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:49.071256 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.162111 [ 2187 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpbba09bb3-8cd2-4cf9-9c42-6916d4aa7306' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:49.164188 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.167238 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.169243 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 4265578 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.288456 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7f573246-3d6c-4d45-b82e-74695808eb02' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:49.291072 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.307044 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp7661f708-f064-47d5-b96d-65e2270512df' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:49.321779 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.321967 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 5073852 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.368977 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp94e3fe2b-a1ba-48dd-bb30-041a388f650c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:49.376563 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.460984 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp5a8e6a23-6600-407d-a240-f98537ffab51' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:49.521368 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 5166647 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031cccb46 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d9693f9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.524862 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.563195 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp109381c1-e8cf-4b4a-8c51-3d4bedcff985' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:49.583672 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.584354 [ 2188 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp4b19cd34-6b7c-424b-ac58-9293df7efccb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:49.584662 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_56_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1232671 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.590145 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.614156 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp75f25c07-c042-4340-a558-f3c133542135' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:49.992203 [ 2307 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 4195235 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(char8_t const*, char8_t const*) @ 0x000000001d62a65a in /usr/bin/clickhouse 8. ./build_docker/./src/Columns/ColumnString.cpp:34: DB::ColumnString::ColumnString(DB::ColumnString const&) @ 0x00000000326da269 in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper::clone() const @ 0x00000000326f2288 in /usr/bin/clickhouse 10. DB::IColumn::mutate(COW::immutable_ptr) @ 0x000000000cf55c03 in /usr/bin/clickhouse 11. void std::__invoke_void_return_wrapper::__call::immutable_ptr)::'lambda'(COW::chameleon_ptr&)&, COW::chameleon_ptr&>(DB::IColumn::mutate(COW::immutable_ptr)::'lambda'(COW::chameleon_ptr&)&, COW::chameleon_ptr&) @ 0x000000000cf5617b in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::ColumnTuple::forEachSubcolumn(std::function::chameleon_ptr&)>) @ 0x000000003275bc13 in /usr/bin/clickhouse 13. DB::IColumn::mutate(COW::immutable_ptr) @ 0x000000000cf55d4b in /usr/bin/clickhouse 14. void std::__invoke_void_return_wrapper::__call::immutable_ptr)::'lambda'(COW::chameleon_ptr&)&, COW::chameleon_ptr&>(DB::IColumn::mutate(COW::immutable_ptr)::'lambda'(COW::chameleon_ptr&)&, COW::chameleon_ptr&) @ 0x000000000cf5617b in /usr/bin/clickhouse 15. DB::IColumn::mutate(COW::immutable_ptr) @ 0x000000000cf55d4b in /usr/bin/clickhouse 16. ./build_docker/./src/Core/Block.cpp:470: DB::Block::mutateColumns() @ 0x000000002e6a0083 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x000000003415b994 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x00000000345c211c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345abb85 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ca0bd9 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c9e6c6 in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d966779 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.992363 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:49.995236 [ 11978 ] {4fed1814-682a-4f88-aaaa-e759c235e881} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49584) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:50.025768 [ 2095 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.025895 [ 2018 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.026169 [ 2059 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.026439 [ 1996 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.026696 [ 2029 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.026816 [ 2100 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.026508 [ 11839 ] {230e2776-2c6f-4ff5-8c45-d5dc02e2ce06} executeQuery: Code: 46. DB::Exception: User-defined function '02101_test_function' doesn't exist. (UNKNOWN_FUNCTION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49564) (comment: 02101_sql_user_defined_functions_drop_if_exists.sql) (in query: DROP FUNCTION 02101_test_function;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/UserDefined/UserDefinedSQLFunctionFactory.cpp:167: DB::UserDefinedSQLFunctionFactory::unregisterFunction(std::shared_ptr const&, String const&, bool) @ 0x0000000035e9bcff in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterDropFunctionQuery.cpp:0: DB::InterpreterDropFunctionQuery::execute() @ 0x000000003148c5e5 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:50.027227 [ 11978 ] {4fed1814-682a-4f88-aaaa-e759c235e881} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:50.028119 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp2f85ec2f-fa81-46b8-ae1a-55293c688b30' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:50.040004 [ 11839 ] {230e2776-2c6f-4ff5-8c45-d5dc02e2ce06} TCPHandler: Code: 46. DB::Exception: User-defined function '02101_test_function' doesn't exist. (UNKNOWN_FUNCTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/UserDefined/UserDefinedSQLFunctionFactory.cpp:167: DB::UserDefinedSQLFunctionFactory::unregisterFunction(std::shared_ptr const&, String const&, bool) @ 0x0000000035e9bcff in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterDropFunctionQuery.cpp:0: DB::InterpreterDropFunctionQuery::execute() @ 0x000000003148c5e5 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:50.040355 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.061306 [ 11408 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.160344 [ 2310 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 5166657 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cbf959 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.167342 [ 2187 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp87a45990-75e7-46ef-9aab-dee08e572e5a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:50.171091 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.223401 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpdeec8292-c4a6-44ea-8903-fe4e3098c699' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:50.225775 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.247429 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpb4bf0914-1b14-4ce5-8217-d27ec54144fe' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:50.254718 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.255729 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp759f0dd0-ff5d-457d-9824-49420757ce76' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:50.258049 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.397789 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc3b6cb26-2d58-4dec-8ec4-68ac67798316' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:50.400190 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.506466 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp49e15e3d-0e8c-4f12-b624-8c824baeeb1e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:50.549184 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.567472 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp6376f2ce-d166-4203-bcf0-d0931c8cc855' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:50.570438 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.572500 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpddd4f624-9d46-4bde-8566-f8af2f5cf256' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:50.588875 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.604831 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpa84a8ff6-8839-468d-8feb-d313f5aca237' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:50.610226 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.622619 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp91353c61-cfb5-4332-915c-304ead71e68d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:50.646245 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.718528 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpcf9c5f05-4ba7-4cfc-8229-0143ff0e522b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:50.721664 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.848907 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc52f7746-3d4d-4b63-a6f1-a5b277c57a53' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:50.851031 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.888401 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp635f1c8e-c422-4290-86f2-1fa7e030cd15' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:50.890010 [ 3735 ] {0b3ea6b5-df01-47ef-929d-6de98e99e002} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49616) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:50.890524 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:50.892536 [ 3735 ] {0b3ea6b5-df01-47ef-929d-6de98e99e002} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:50.982111 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpbf572ede-9447-4e5a-95c2-57fa8b137f6d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:50.985523 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.011183 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpf05a8f99-1c5f-43ff-a1fa-41972a342bcb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:51.019674 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp436d591f-079f-4e5a-8884-78d099b9b36b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:51.021673 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.023538 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.027648 [ 2101 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.028088 [ 2048 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.028559 [ 2031 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.035434 [ 2184 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp600e4e4b-6ec6-496b-b279-883809a08f61' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:51.038350 [ 1988 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.038609 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.039154 [ 1987 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.039744 [ 2021 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.088181 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb3f6460c-09ce-4c56-ac27-6aaab6d1a5b7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:51.090674 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.176563 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp56c828a7-646f-46e4-9241-f50754456470' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:51.178912 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.211250 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp413d26af-c811-4974-ba21-41147ce67d32' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:51.215468 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.408039 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpbdda0df4-ddb8-478a-9737-164a880588d0' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:51.532331 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.558173 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpffa95c3b-1527-41c3-8bd2-477703721642' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:51.563942 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.659197 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp2ea2489f-6c33-4143-9718-397ab101415a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:51.688509 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.730128 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb314c307-5e29-4cc2-bf4e-e2bf8ec28783' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:51.744085 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.757312 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp8591c687-8fbe-4c05-a571-29a773ce60ef' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:51.770095 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.777209 [ 3735 ] {9439aa6e-a0df-4461-87e5-099fc246e971} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49624) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:51.782707 [ 3735 ] {9439aa6e-a0df-4461-87e5-099fc246e971} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:51.910237 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp136c5341-ed07-4ee3-9115-fb35be7a6729' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:51.916287 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.918498 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpfc4d53d5-fdde-4a91-9284-2860e6572b09' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:51.930450 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.945198 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7077f1cc-ed14-4fb5-a911-6cbe66efbf2c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:51.947543 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.954860 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp9e450fbf-8e4c-4d1e-b21c-11122f1569da' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:51.957593 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:51.986534 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp99d7f52d-4970-48b3-a35b-34332ceaf4a4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:51.990012 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:52.036937 [ 1977 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:52.037762 [ 2038 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:52.038388 [ 2041 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:52.041362 [ 2061 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:52.042309 [ 2018 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:52.042510 [ 2095 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:52.065378 [ 11408 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:52.091222 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp28b1045a-c17a-41ce-8ff1-d1d870b1ff61' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:52.095067 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:52.137667 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp525df0c4-491a-4285-875e-e7f16fb53348' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:52.139731 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:52.155218 [ 2196 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpf650a4e7-ed90-4bdf-afcd-0e6481fe4db5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:52.158436 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:52.159489 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp43895391-eeb9-4824-9c32-290123a866c7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:52.161714 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:52.292596 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp90c77e60-98d0-45d0-8160-5555cd819ed5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:52.309854 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:52.367810 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpe6d00fa8-9f86-4c90-8017-12e2bb735e62' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:52.375959 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:52.422667 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp68c8f41d-5cc8-4ae7-ad17-6dd2df4b12b7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:52.437473 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp78d079a2-564a-4bcd-a3ce-eeb77a61ff05' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:52.439510 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:52.444160 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:52.502305 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpea919e1b-4c38-4f1d-bfb2-9794ac8b666e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:52.513069 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc1d83c54-67a4-4976-8feb-c4283cd7f60c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:53.049891 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 5157844 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5d88 in /usr/bin/clickhouse 8. ./build_docker/./src/Columns/ColumnString.cpp:0: COW::immutable_ptr DB::ColumnString::indexImpl(DB::PODArray, 63ul, 64ul> const&, unsigned long) const @ 0x00000000326f6ee5 in /usr/bin/clickhouse 9. ./build_docker/./src/Columns/ColumnString.cpp:212: DB::ColumnString::permute(DB::PODArray, 63ul, 64ul> const&, unsigned long) const @ 0x00000000326dc9f0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::permuteBlockIfNeeded(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x000000003416c5ff in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x000000003415b716 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x00000000345c211c in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345abb85 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031ceb946 in /usr/bin/clickhouse 25. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d96ae39 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 28. ? @ 0x00007f11b339dac3 in ? 29. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.050331 [ 2009 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.050561 [ 2077 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.050602 [ 11978 ] {647732f1-0057-42ab-96d8-43662f9516fe} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49652) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:53.050662 [ 2076 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.050798 [ 1982 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.050947 [ 2055 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.052659 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.051877 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.052193 [ 2060 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.075728 [ 11978 ] {647732f1-0057-42ab-96d8-43662f9516fe} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:53.159815 [ 2198 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp85561ad2-8f44-41a3-abdd-76ea8b319c00' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:53.160050 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp654ddc71-116b-449d-8f00-f81a29c83e87' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:53.166590 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.167066 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.245736 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp8554191c-476a-405e-85ea-998975cdf0bc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:53.248485 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.295222 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpb7352b58-6087-4c83-8a25-e9663c7e8afe' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:53.296382 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp8b10900d-0b09-4863-b586-f5fe89e8be74' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:53.314322 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.316702 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.398441 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpfd0ca3af-98f9-4228-b1e4-238e11f771a1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:53.502397 [ 2199 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpd55b7e57-f8b7-4a4f-b48b-c43f955ca57a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:53.503018 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp9223430d-a3c8-4fb2-aa1b-cc993cf92334' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:53.506129 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.506133 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.507538 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.642952 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpf0e1bb99-c44f-4b5f-bc91-d949db737559' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:53.650566 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpef8d3e13-2798-4af0-a74a-c783bb0bb77a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:53.650779 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.653477 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.791061 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7185383b-5fee-417d-8224-4395d1bf4efc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:53.795411 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc5d96b07-beae-453e-8b24-25a804194cd8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:53.815377 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.815519 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.860649 [ 2199 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp182d9cd2-8277-4e23-963e-48fe329f6aef' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:53.868046 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.875666 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp83697baa-65e2-45b0-a643-4389d35d3bdf' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:53.878296 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:53.944696 [ 11978 ] {c5461260-8488-40d1-b9d1-8304bc060a8e} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49686) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:53.947734 [ 11978 ] {c5461260-8488-40d1-b9d1-8304bc060a8e} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:53.999303 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp2d78276b-b697-47ef-953a-da804fae2e27' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:54.011412 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:54.052615 [ 2102 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:54.055749 [ 2003 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:54.064474 [ 2056 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:54.064794 [ 2001 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:54.065087 [ 2022 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:54.075975 [ 2087 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:54.942502 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_56_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1232671 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:54.976192 [ 3735 ] {37928b22-a7e7-42cc-b3da-b14cf6fe8ba8} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49710) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:55.054535 [ 2068 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:55.058425 [ 2078 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:55.065292 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1118460 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:55.066561 [ 2089 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:55.067995 [ 2083 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:55.068023 [ 2035 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:55.078009 [ 2007 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:55.091355 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1192480 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_17_17_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a5a2 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:55.161879 [ 3735 ] {37928b22-a7e7-42cc-b3da-b14cf6fe8ba8} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:55.321175 [ 11419 ] {25c56c0e-76ea-4e67-98f7-f6521e3a3357} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1049724 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: Cache info: Buffer path: common/nvq/ysgkytvcrghbbyolffdgbpxbhhjsu, hash key: b3843ecf84502607d8ba19697341a641, file_offset_of_buffer_end: 0, read_until_position: 222, internal buffer end: 222, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 25c56c0e-76ea-4e67-98f7-f6521e3a3357:2395, file segment info: File segment: [0, 221], key: b3843ecf84502607d8ba19697341a641, state: DOWNLOADING, downloaded size: 0, reserved size: 222, downloader id: 25c56c0e-76ea-4e67-98f7-f6521e3a3357:2395, current write offset: 0, caller id: 25c56c0e-76ea-4e67-98f7-f6521e3a3357:2395, kind: Regular, unbound: 0: (while reading column ParsedParams.Key2): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 91351): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49558) (comment: 00094_order_by_array_join_limit.sql) (in query: SELECT `ParsedParams.Key2` AS x FROM test.hits ARRAY JOIN ParsedParams AS PP ORDER BY x ASC LIMIT 2;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 5. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 17. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec784a9 in /usr/bin/clickhouse 18. ./build_docker/./src/IO/ReadBuffer.h:72: DB::MergeTreeMarksLoader::loadMarksImpl() @ 0x00000000343aece8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::MergeTreeMarksLoader::loadMarks() @ 0x00000000343ac8a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/threadPoolCallbackRunner.h:43: std::__packaged_task_func> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'(), std::allocator> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'()>, std::shared_ptr ()>::operator()() @ 0x00000000343b2cba in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task ()>::operator()() @ 0x00000000343b7f6c in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:55.495711 [ 11419 ] {25c56c0e-76ea-4e67-98f7-f6521e3a3357} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1049724 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Waiting timeout for memory to be freed is reached.: Cache info: Buffer path: common/nvq/ysgkytvcrghbbyolffdgbpxbhhjsu, hash key: b3843ecf84502607d8ba19697341a641, file_offset_of_buffer_end: 0, read_until_position: 222, internal buffer end: 222, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 25c56c0e-76ea-4e67-98f7-f6521e3a3357:2395, file segment info: File segment: [0, 221], key: b3843ecf84502607d8ba19697341a641, state: DOWNLOADING, downloaded size: 0, reserved size: 222, downloader id: 25c56c0e-76ea-4e67-98f7-f6521e3a3357:2395, current write offset: 0, caller id: 25c56c0e-76ea-4e67-98f7-f6521e3a3357:2395, kind: Regular, unbound: 0: (while reading column ParsedParams.Key2): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 91351): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 5. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 17. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec784a9 in /usr/bin/clickhouse 18. ./build_docker/./src/IO/ReadBuffer.h:72: DB::MergeTreeMarksLoader::loadMarksImpl() @ 0x00000000343aece8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::MergeTreeMarksLoader::loadMarks() @ 0x00000000343ac8a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/threadPoolCallbackRunner.h:43: std::__packaged_task_func> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'(), std::allocator> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'()>, std::shared_ptr ()>::operator()() @ 0x00000000343b2cba in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task ()>::operator()() @ 0x00000000343b7f6c in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:55.752718 [ 11419 ] {} TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:32: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x000000002e2d4fef in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges&, DB::SettingSource) const @ 0x000000002f94f2c3 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:1704: DB::TCPHandler::receiveQuery() @ 0x0000000034f06780 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x0000000034eec063 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed58db in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:56.039733 [ 2188 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp6911c7f1-a9c3-419d-b636-8890186ea2c6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:56.045015 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.059918 [ 2013 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.060437 [ 2075 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.068404 [ 2009 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.069688 [ 2077 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.069985 [ 2076 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.081540 [ 2055 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.081753 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1060951 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column EventDate): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_15_15_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a5a2 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 19. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 20. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.110343 [ 3735 ] {07ed17cf-aef7-41b8-856f-e71d9c50ffa9} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49764) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count FROM dst;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:56.119209 [ 3735 ] {07ed17cf-aef7-41b8-856f-e71d9c50ffa9} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007f11b339dac3 in ? 22. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:56.311614 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:84: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b5bc in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.311718 [ 11978 ] {aabf5052-f72a-4d16-83e0-ebe61ab2a147} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1455488 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: while converting source column number to destination column id: while executing 'FUNCTION _CAST(number :: 0, UInt32 :: 2) -> _CAST(number, UInt32) UInt32 : 4'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49722) (comment: 01780_column_sparse_distinct.sql) (in query: INSERT INTO t_sparse_distinct SELECT number, number % 6 FROM numbers(100000);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89205 in /usr/bin/clickhouse 10. COW::immutable_ptr DB::ConvertImpl, DB::DataTypeNumber, DB::NameToUInt32, DB::ConvertDefaultBehaviorTag>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000bf0bee1 in /usr/bin/clickhouse 11. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToUInt32, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000bef161c in /usr/bin/clickhouse 12. DB::FunctionConvert, DB::NameToUInt32, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000beea766 in /usr/bin/clickhouse 13. DB::FunctionConvert, DB::NameToUInt32, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bee842a in /usr/bin/clickhouse 14. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 17. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 18. DB::IFunctionBase::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000000bd84c5d in /usr/bin/clickhouse 19. COW::immutable_ptr std::__function::__policy_invoker::immutable_ptr (std::vector>&, std::shared_ptr const&, DB::ColumnNullable const*, unsigned long)>::__call_impl::createFunctionAdaptor(std::shared_ptr, std::shared_ptr const&)::'lambda'(std::vector>&, std::shared_ptr const&, DB::ColumnNullable const*, unsigned long), COW::immutable_ptr (std::vector>&, std::shared_ptr const&, DB::ColumnNullable const*, unsigned long)>>(std::__function::__policy_storage const*, std::vector>&, std::shared_ptr const&, DB::ColumnNullable const*, unsigned long) @ 0x000000000bdfd181 in /usr/bin/clickhouse 20. DB::ExecutableFunctionCast::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bda4842 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e9b1 in /usr/bin/clickhouse 23. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 2024.10.22 00:33:56.313023 [ 2191 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp5d126b3c-8c02-4dd5-b1e2-d92bb251b2ee' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:56.329273 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.328272 [ 11978 ] {aabf5052-f72a-4d16-83e0-ebe61ab2a147} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1455488 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: while converting source column number to destination column id: while executing 'FUNCTION _CAST(number :: 0, UInt32 :: 2) -> _CAST(number, UInt32) UInt32 : 4'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89205 in /usr/bin/clickhouse 10. COW::immutable_ptr DB::ConvertImpl, DB::DataTypeNumber, DB::NameToUInt32, DB::ConvertDefaultBehaviorTag>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, void*) @ 0x000000000bf0bee1 in /usr/bin/clickhouse 11. bool DB::callOnIndexAndDataType, DB::FunctionConvert, DB::NameToUInt32, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000bef161c in /usr/bin/clickhouse 12. DB::FunctionConvert, DB::NameToUInt32, DB::ToNumberMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000beea766 in /usr/bin/clickhouse 13. DB::FunctionConvert, DB::NameToUInt32, DB::ToNumberMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bee842a in /usr/bin/clickhouse 14. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 17. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 18. DB::IFunctionBase::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000000bd84c5d in /usr/bin/clickhouse 19. COW::immutable_ptr std::__function::__policy_invoker::immutable_ptr (std::vector>&, std::shared_ptr const&, DB::ColumnNullable const*, unsigned long)>::__call_impl::createFunctionAdaptor(std::shared_ptr, std::shared_ptr const&)::'lambda'(std::vector>&, std::shared_ptr const&, DB::ColumnNullable const*, unsigned long), COW::immutable_ptr (std::vector>&, std::shared_ptr const&, DB::ColumnNullable const*, unsigned long)>>(std::__function::__policy_storage const*, std::vector>&, std::shared_ptr const&, DB::ColumnNullable const*, unsigned long) @ 0x000000000bdfd181 in /usr/bin/clickhouse 20. DB::ExecutableFunctionCast::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bda4842 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 22. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e9b1 in /usr/bin/clickhouse 23. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 2024.10.22 00:33:56.364006 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp8cd0b812-063b-4eaf-a198-580d062319e9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:56.371166 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.379784 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.380589 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e9011b in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 19. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.462922 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpf8e32e16-2614-472e-ae95-68dc817d7037' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:56.509507 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp3e7ade31-7ffb-4d77-9b3b-3c74ad1a2202' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:56.600543 [ 2241 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 5065437 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c726b9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c701a6 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d963a79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.602394 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.602590 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.601628 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 4270682 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.608804 [ 11978 ] {34362863-e990-466b-853c-5c2d9f69f3c4} executeQuery: Code: 60. DB::Exception: Table test_5.wv does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49778) (comment: 01055_window_view_proc_hop_to.sh) (in query: DROP TABLE wv;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:941: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb39eb2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116bf05 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:92: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000003116a56b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168302 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:56.614660 [ 11978 ] {34362863-e990-466b-853c-5c2d9f69f3c4} TCPHandler: Code: 60. DB::Exception: Table test_5.wv does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:941: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb39eb2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116bf05 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:92: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000003116a56b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168302 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:56.642991 [ 2187 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp9d274d68-bbb2-4a28-8492-052a1ef29279' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:56.649129 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.650764 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpe85861f7-143d-407c-a438-af2fc5b43f85' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:56.653765 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.874454 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 4813052 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x00000000343d6317 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x00000000343d5adf in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x00000000345c6dbf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c4485 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ac548 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c62f99 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c60a86 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.962260 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 5061756 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.968282 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:56.994586 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:84: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b5bc in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:57.062129 [ 2039 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:57.062344 [ 2071 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:57.076320 [ 2043 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:57.076516 [ 2067 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:57.077167 [ 2062 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:57.083138 [ 1978 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:57.116507 [ 11978 ] {97abd55a-df29-4237-b19f-9c166b81a2ad} executeQuery: Code: 60. DB::Exception: Table test_5.mt does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49788) (comment: 01055_window_view_proc_hop_to.sh) (in query: DROP TABLE mt;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:941: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb39eb2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116bf05 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:92: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000003116a56b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168302 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:57.140886 [ 11978 ] {97abd55a-df29-4237-b19f-9c166b81a2ad} TCPHandler: Code: 60. DB::Exception: Table test_5.mt does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:941: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb39eb2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116bf05 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:92: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000003116a56b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168302 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:57.200513 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 5156344 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5d88 in /usr/bin/clickhouse 8. ./build_docker/./src/Columns/ColumnString.cpp:0: COW::immutable_ptr DB::ColumnString::indexImpl(DB::PODArray, 63ul, 64ul> const&, unsigned long) const @ 0x00000000326f6ee5 in /usr/bin/clickhouse 9. ./build_docker/./src/Columns/ColumnString.cpp:212: DB::ColumnString::permute(DB::PODArray, 63ul, 64ul> const&, unsigned long) const @ 0x00000000326dc9f0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::permuteBlockIfNeeded(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x000000003416c5ff in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x000000003415b716 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x00000000345c211c in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345abb85 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031ceb946 in /usr/bin/clickhouse 25. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d96ae39 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 28. ? @ 0x00007f11b339dac3 in ? 29. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:57.203980 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 5149495 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031cccb46 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d9693f9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:57.230395 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:57.345357 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 5160832 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:57.448801 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp4af7d345-20e3-48c6-8a26-e81fff051c9a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:57.451891 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:57.665647 [ 11992 ] {dfbf866b-bfad-47de-aed7-2326697868c5} executeQuery: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49810) (comment: 01055_window_view_proc_hop_to.sh) (in query: DROP TABLE dst;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:941: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb39eb2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116bf05 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:92: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000003116a56b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168302 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:57.679480 [ 11992 ] {dfbf866b-bfad-47de-aed7-2326697868c5} TCPHandler: Code: 60. DB::Exception: Table test_5.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:941: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb39eb2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000003116bf05 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:92: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000003116a56b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterDropQuery.cpp:0: DB::InterpreterDropQuery::execute() @ 0x0000000031168302 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:57.691707 [ 2194 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp61ebcd9b-7103-4785-ad10-9ea313d7a314' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:57.696513 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:57.728923 [ 2310 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5165377 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cbf959 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:57.792763 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1092091 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_10_10_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec79c47 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f21ac50 in /usr/bin/clickhouse 12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:58.103925 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:58.164027 [ 2003 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:58.164523 [ 2022 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:58.165001 [ 2087 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:58.165768 [ 2003 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:58.165992 [ 2020 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:58.166338 [ 2074 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:58.196762 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 5160832 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:58.229191 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:58.355747 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4197490 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:58.388211 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp6a2cd665-0dfb-42b0-9a09-b698f423dd9d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:58.390410 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:58.439857 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 5170743 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031cccb46 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d9693f9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:58.440245 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1355998 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_18_18_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:58.833418 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1114301 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:58.894411 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:58.928142 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:59.100721 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp81f993c5-6dcd-44f5-a644-032fbca17987' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:59.141526 [ 12113 ] {02290_client_insert_cancel_test_13} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 4194304 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49834) (comment: 02290_client_insert_cancel.sh) (in query: insert into function null('n Int') format TSV), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89205 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f22a766 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./src/Formats/NativeReader.cpp:0: DB::NativeReader::readData(DB::ISerialization const&, COW::immutable_ptr&, DB::ReadBuffer&, unsigned long, double) @ 0x0000000034f7e63e in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::NativeReader::read() @ 0x0000000034f80c00 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x0000000034f0cddd in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x0000000034eec419 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x0000000034ef326f in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x0000000034eee033 in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:503: DB::TCPHandler::runImpl() @ 0x0000000034ed6f7c in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 24. ? @ 0x00007f11b339dac3 in ? 25. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:59.142571 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:59.165331 [ 2103 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:59.165967 [ 2057 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:59.166882 [ 2068 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:59.167604 [ 2089 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:59.168363 [ 2083 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:59.168862 [ 2035 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:59.173888 [ 12113 ] {02290_client_insert_cancel_test_13} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 4194304 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<4ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd89205 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/PODArray.h:321: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f22a766 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./src/Formats/NativeReader.cpp:0: DB::NativeReader::readData(DB::ISerialization const&, COW::immutable_ptr&, DB::ReadBuffer&, unsigned long, double) @ 0x0000000034f7e63e in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::NativeReader::read() @ 0x0000000034f80c00 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/vector:537: DB::TCPHandler::receiveData(bool) @ 0x0000000034f0cddd in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x0000000034eec419 in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:795: DB::TCPHandler::readDataNext() @ 0x0000000034ef326f in /usr/bin/clickhouse 17. ./build_docker/./src/Server/TCPHandler.cpp:861: DB::TCPHandler::processInsertQuery() @ 0x0000000034eee033 in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:503: DB::TCPHandler::runImpl() @ 0x0000000034ed6f7c in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 24. ? @ 0x00007f11b339dac3 in ? 25. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:59.256324 [ 11978 ] {b5241898-2a2b-4ad2-aae0-5f6ceb17e175} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1966208 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION toString(number : 0) -> toString(number) String : 1'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49812) (comment: 01042_check_query_and_last_granule_size.sql) (in query: -- Number of rows in last granule should be equals to granularity. -- Rows in this table are short, so granularity will be 8192. INSERT INTO check_query_test SELECT number, toString(number) FROM system.numbers LIMIT 81920;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd8d085 in /usr/bin/clickhouse 10. DB::ConvertImpl, DB::DataTypeString, DB::NameToString, DB::ConvertDefaultBehaviorTag>::execute(std::vector> const&, std::shared_ptr const&, unsigned long) @ 0x000000000c69a26e in /usr/bin/clickhouse 11. bool DB::callOnIndexAndDataType::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c690fa1 in /usr/bin/clickhouse 12. DB::FunctionConvert::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c68e793 in /usr/bin/clickhouse 13. DB::FunctionConvert::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c68c52a in /usr/bin/clickhouse 14. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 17. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:59.260318 [ 2310 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5165249 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cbf959 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:59.274933 [ 12113 ] {fb12de3a-77f3-447f-8390-0f4d7c634e7e} executeQuery: Code: 62. DB::Exception: Syntax error: failed at position 1 (''): . Unrecognized token: ''. (SYNTAX_ERROR) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49834) (in query: ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000cd8ec70 in /usr/bin/clickhouse 3. ./build_docker/./src/Parsers/parseQuery.cpp:363: DB::parseQueryAndMovePosition(DB::IParser&, char const*&, char const*, String const&, bool, unsigned long, unsigned long) @ 0x00000000367894aa in /usr/bin/clickhouse 4. ./build_docker/./src/Parsers/parseQuery.cpp:375: DB::parseQuery(DB::IParser&, char const*, char const*, String const&, unsigned long, unsigned long) @ 0x0000000036789717 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e7ac4 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:59.296595 [ 11978 ] {b5241898-2a2b-4ad2-aae0-5f6ceb17e175} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1966208 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION toString(number : 0) -> toString(number) String : 1'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd8d085 in /usr/bin/clickhouse 10. DB::ConvertImpl, DB::DataTypeString, DB::NameToString, DB::ConvertDefaultBehaviorTag>::execute(std::vector> const&, std::shared_ptr const&, unsigned long) @ 0x000000000c69a26e in /usr/bin/clickhouse 11. bool DB::callOnIndexAndDataType::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c690fa1 in /usr/bin/clickhouse 12. DB::FunctionConvert::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c68e793 in /usr/bin/clickhouse 13. DB::FunctionConvert::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c68c52a in /usr/bin/clickhouse 14. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 17. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:59.382676 [ 12113 ] {fb12de3a-77f3-447f-8390-0f4d7c634e7e} TCPHandler: Code: 62. DB::Exception: Syntax error: failed at position 1 (''): . Unrecognized token: ''. (SYNTAX_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000cd8ec70 in /usr/bin/clickhouse 3. ./build_docker/./src/Parsers/parseQuery.cpp:363: DB::parseQueryAndMovePosition(DB::IParser&, char const*&, char const*, String const&, bool, unsigned long, unsigned long) @ 0x00000000367894aa in /usr/bin/clickhouse 4. ./build_docker/./src/Parsers/parseQuery.cpp:375: DB::parseQuery(DB::IParser&, char const*, char const*, String const&, unsigned long, unsigned long) @ 0x0000000036789717 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320e7ac4 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:33:59.384306 [ 12113 ] {fb12de3a-77f3-447f-8390-0f4d7c634e7e} TCPHandler: Can't skip data packets after query failure. 2024.10.22 00:33:59.394334 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:84: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b5bc in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:59.521282 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpfe1c3cc7-c651-4e4f-b1e2-a3dc16fe9317' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:59.539506 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:59.684805 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:84: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b5bc in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:59.712358 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:59.712422 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp90ea163a-005b-44b3-a4d2-fd7fb3d339dd' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:59.713384 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpa3cc49ff-85d1-4103-a009-caecc169ae91' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:59.715306 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:59.717552 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:59.732585 [ 11406 ] {176675ec-7829-45ee-b7de-ee5af7e5a4bf} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/mzb/lgcsczijcdyixywgzarpnruzovfis, hash key: 85ec2b5df9fe44881e77a58f1fc0617d, file_offset_of_buffer_end: 0, read_until_position: 342629, internal buffer end: 342629, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 176675ec-7829-45ee-b7de-ee5af7e5a4bf:20508, file segment info: File segment: [0, 342628], key: 85ec2b5df9fe44881e77a58f1fc0617d, state: DOWNLOADING, downloaded size: 0, reserved size: 342629, downloader id: 176675ec-7829-45ee-b7de-ee5af7e5a4bf:20508, current write offset: 0, caller id: 176675ec-7829-45ee-b7de-ee5af7e5a4bf:20508, kind: Regular, unbound: 0: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_23_23_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:45942) (comment: 00159_parallel_formatting_csv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format CSV), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 19. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x000000002ec749b2 in /usr/bin/clickhouse 20. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec795a1 in /usr/bin/clickhouse 21. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:101: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f1aa586 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 2024.10.22 00:33:59.754291 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp44fc5a1d-db68-44b0-a32c-26e1bc1983ad' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:33:59.757289 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:33:59.779048 [ 11406 ] {176675ec-7829-45ee-b7de-ee5af7e5a4bf} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/mzb/lgcsczijcdyixywgzarpnruzovfis, hash key: 85ec2b5df9fe44881e77a58f1fc0617d, file_offset_of_buffer_end: 0, read_until_position: 342629, internal buffer end: 342629, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 176675ec-7829-45ee-b7de-ee5af7e5a4bf:20508, file segment info: File segment: [0, 342628], key: 85ec2b5df9fe44881e77a58f1fc0617d, state: DOWNLOADING, downloaded size: 0, reserved size: 342629, downloader id: 176675ec-7829-45ee-b7de-ee5af7e5a4bf:20508, current write offset: 0, caller id: 176675ec-7829-45ee-b7de-ee5af7e5a4bf:20508, kind: Regular, unbound: 0: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_23_23_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 19. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x000000002ec749b2 in /usr/bin/clickhouse 20. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec795a1 in /usr/bin/clickhouse 21. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:101: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f1aa586 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 2024.10.22 00:34:00.013956 [ 2196 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp76d0f399-ad3f-40f5-879c-9660088e9107' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:00.014294 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.017628 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.046883 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp481d0fd6-d157-414b-b215-0452b43e06af' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:00.149974 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpfa33a23d-fe3c-4b71-853a-29dd3c72748c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:00.265761 [ 3877 ] {ba0942e1-a66f-421c-a56c-9dcdf97f4e56} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1221995 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column query_id): (while reading from part /var/lib/clickhouse/disks/s3/store/6e4/6e4fe0b1-5b27-4b1d-845a-88e783da8be0/202410_1_49_8/ in table system.query_log (6e4fe0b1-5b27-4b1d-845a-88e783da8be0) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8022): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:49774) (comment: 02765_queries_with_subqueries_profile_events.sh) (in query: SELECT 1 view, 1 allow_experimental_analyzer, ProfileEvents['InsertQuery'] InsertQuery, ProfileEvents['SelectQuery'] SelectQuery, ProfileEvents['InsertQueriesWithSubqueries'] InsertQueriesWithSubqueries, -- FIXME: for analyzer it will have one more for sample block ProfileEvents['SelectQueriesWithSubqueries'] SelectQueriesWithSubqueries, ProfileEvents['QueriesWithSubqueries'] QueriesWithSubqueries FROM system.query_log WHERE current_database = currentDatabase() AND type = 'QueryFinish' AND query_id = 'vakuycuorw' FORMAT TSVWithNames;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray, 63ul, 64ul>&, DB::PODArray, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x000000002f2832c7 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27dda3 in /usr/bin/clickhouse 12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? 2024.10.22 00:34:00.266159 [ 1994 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.266200 [ 1982 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.266116 [ 2060 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.266924 [ 1986 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.266929 [ 2098 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.272531 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.273324 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.280072 [ 2028 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.280657 [ 3877 ] {ba0942e1-a66f-421c-a56c-9dcdf97f4e56} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1221995 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column query_id): (while reading from part /var/lib/clickhouse/disks/s3/store/6e4/6e4fe0b1-5b27-4b1d-845a-88e783da8be0/202410_1_49_8/ in table system.query_log (6e4fe0b1-5b27-4b1d-845a-88e783da8be0) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8022): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray, 63ul, 64ul>&, DB::PODArray, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x000000002f2832c7 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27dda3 in /usr/bin/clickhouse 12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? 2024.10.22 00:34:00.334755 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpd8b30173-98ca-4418-9a24-4be7212a34ae' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:00.349703 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpf52daa80-5c4a-430f-878b-4a13ec7c1c2e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:00.487936 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.488038 [ 11992 ] {7a58de9a-2e27-4d2e-895f-fc224e948784} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1049025 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01070_alter_with_ttl.sql) (in query: /* ddl_entry=query-0000000021 */ CREATE TABLE test_5.alter_ttl UUID '9a268fac-a5ec-4aa5-82e4-6d40c7178d75' (`i` Int32) ENGINE = MergeTree ORDER BY i TTL toDate('2020-05-05')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:00.489568 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.517539 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp9107ce36-edd9-4d78-999f-5011709509b6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:00.531781 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.534631 [ 11992 ] {7a58de9a-2e27-4d2e-895f-fc224e948784} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1049025 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:45966) (comment: 01070_alter_with_ttl.sql) (in query: create table alter_ttl(i Int) engine = MergeTree order by i ttl toDate('2020-05-05');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:00.537935 [ 11992 ] {7a58de9a-2e27-4d2e-895f-fc224e948784} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1049025 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:00.553089 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.630855 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe66e4029-efea-41f3-a6ad-1e1dc745db9e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:00.635677 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.657859 [ 11992 ] {} TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:32: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x000000002e2d4fef in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges&, DB::SettingSource) const @ 0x000000002f94f2c3 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:1704: DB::TCPHandler::receiveQuery() @ 0x0000000034f06780 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x0000000034eec063 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed58db in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:00.678329 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpbd85118f-76f8-4c38-9e17-9654c97c11c3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:00.680258 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.800410 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp5f30f77b-dbf5-4e5e-9f03-013086ba71c1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:00.887066 [ 11978 ] {e34354f9-90ab-443f-b801-1e9e2e01e42d} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1391268 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_23_23_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:45972) (comment: 00159_parallel_formatting_csv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format CSV), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5d88 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:0: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f1aa515 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:00.888753 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.911446 [ 11978 ] {e34354f9-90ab-443f-b801-1e9e2e01e42d} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1391268 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_23_23_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5d88 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:0: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f1aa515 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:00.945906 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb5a918a0-56d3-454f-bc39-d68db65e999c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:00.946318 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp02ec2246-6224-497d-8b97-6cad1c9ee61b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:00.957322 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:00.958371 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.041588 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp0bd0eef8-1ddf-4c6a-be61-7833a713eed2' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:01.044933 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.051585 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp511ac0b9-7421-4151-81f9-62651af08c79' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:01.053829 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.054922 [ 2195 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp7a5b2285-357b-4943-a883-ca0fcc60db40' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:01.058790 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.102877 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp9ece0085-12a0-4efd-a201-76a6cf7b8b29' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:01.103366 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe5ce1c42-30f0-49b7-894a-8dffeadf60c7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:01.112719 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.112783 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.187523 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp82f331a0-34e6-4ce8-b77b-455cf044aeff' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:01.190916 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpfb87160b-7930-4fbc-8f78-356e9cd001c1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:01.193320 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.194298 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.233970 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpbedb60c6-72d5-441e-af63-543758c223e9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:01.243280 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp6eb94c8a-1d3e-4c05-b7f1-526ad17f9ecf' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:01.244968 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.252352 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.268135 [ 2058 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.268613 [ 2105 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.269111 [ 2026 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.269669 [ 2056 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.270405 [ 2001 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.281701 [ 2096 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.399160 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp88a9f81e-305c-4235-8bb0-d28b60191403' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:01.399212 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp86766db4-8f58-45b9-9245-af9c5ed1a265' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:01.404449 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.404995 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.463321 [ 2241 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5236829 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c726b9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c701a6 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d963a79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.470931 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpf7b434c6-4120-42c5-b89a-c2377788ce8c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:01.476909 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.535444 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp52501548-d03c-4aeb-ae64-9ed1ee9494c6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:01.877579 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 4840671 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(char8_t const*, char8_t const*) @ 0x000000001d62a65a in /usr/bin/clickhouse 8. ./build_docker/./src/Columns/ColumnString.cpp:34: DB::ColumnString::ColumnString(DB::ColumnString const&) @ 0x00000000326da269 in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:69: COWHelper::clone() const @ 0x00000000326f2288 in /usr/bin/clickhouse 10. DB::IColumn::mutate(COW::immutable_ptr) @ 0x000000000cf55c03 in /usr/bin/clickhouse 11. ./build_docker/./src/Core/Block.cpp:470: DB::Block::mutateColumns() @ 0x000000002e6a0083 in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::write(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x000000003415b994 in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::writeWithPermutation(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x00000000345c211c in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345abb85 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031ceb946 in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d96ae39 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.879205 [ 11992 ] {420fcdba-c740-4bc6-95bd-0dbba16c401f} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1391268 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_23_23_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46022) (comment: 00159_parallel_formatting_csv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format CSVWithNames), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5d88 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:0: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f1aa515 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:01.883955 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5074052 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.885213 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.889039 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.890663 [ 11992 ] {420fcdba-c740-4bc6-95bd-0dbba16c401f} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1391268 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_23_23_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5d88 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:0: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f1aa515 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:01.930221 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp630debca-94ed-4e8a-a9a1-80a1c3568e89' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:01.935321 [ 12007 ] {58659a86-2344-41fa-86c0-177fc403d281} ExecutingGraph: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ParallelFormattingOutputFormat::formatterThreadFunction(unsigned long, unsigned long, std::shared_ptr const&) @ 0x000000003545a796 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 11. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.936772 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.937217 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp796dfc18-4fb1-4434-822d-954aac5a80e8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:01.940229 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:01.941427 [ 12113 ] {58659a86-2344-41fa-86c0-177fc403d281} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46006) (comment: 01514_parallel_formatting.sql) (in query: insert into tsv(a) select number from numbers(10000000);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ParallelFormattingOutputFormat::formatterThreadFunction(unsigned long, unsigned long, std::shared_ptr const&) @ 0x000000003545a796 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 11. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:01.970263 [ 12113 ] {58659a86-2344-41fa-86c0-177fc403d281} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ParallelFormattingOutputFormat::formatterThreadFunction(unsigned long, unsigned long, std::shared_ptr const&) @ 0x000000003545a796 in /usr/bin/clickhouse 10. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 11. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 14. ? @ 0x00007f11b339dac3 in ? 15. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:01.984805 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp9fc8666e-35c6-4075-9fe1-cd01facd81ed' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:02.008313 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpe204d066-8dfd-4bcd-a22a-fc19c49a06d8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:02.075553 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:02.093631 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:02.116330 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp29dd8457-2337-43a9-9baa-1f66a457fe1c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:02.123853 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:02.128817 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp17d61d71-ec6a-45b4-95d5-42fbf20444dd' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:02.133208 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:02.184535 [ 2191 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp8611c286-4f6a-42db-b42d-76b9e79c204a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:02.263228 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpeb211973-c87b-435c-bc4f-066f1fb73d7c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:02.263366 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmpc21c129d-0e51-489f-a4ca-683a05ed043c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:02.437081 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5106684 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x00000000343d6317 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x00000000343d5adf in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x00000000345c6dbf in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c4485 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ac548 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:02.438188 [ 2083 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:02.438327 [ 2035 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:02.437962 [ 2089 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:02.438460 [ 2012 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:02.438818 [ 2103 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:02.438731 [ 2007 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:02.443264 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:02.443938 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:02.448978 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:02.545261 [ 11406 ] {8ec937b8-9eb6-4f63-8d49-2560f63cd98a} executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46084) (comment: 02481_analyzer_optimize_aggregation_arithmetics.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:02.549623 [ 11406 ] {8ec937b8-9eb6-4f63-8d49-2560f63cd98a} TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:02.803238 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp818d5eac-5bb5-47fc-a298-9fbf28a6a737' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:02.816951 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:02.871488 [ 11992 ] {e82b82e9-b6ec-40f8-8aaf-10469e248363} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1391268 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_23_23_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46070) (comment: 00159_parallel_formatting_csv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format CSVWithNames), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5d88 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:0: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f1aa515 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:02.884119 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpf6fcb2bf-aa7e-4736-823b-5197f8a8ab24' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:02.888136 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:02.892342 [ 11992 ] {e82b82e9-b6ec-40f8-8aaf-10469e248363} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1391268 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_23_23_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 40960): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5d88 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationFixedString.cpp:0: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f1aa515 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 26. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:02.915368 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp637d79ad-7d1b-4fca-abfb-e98ed78bd534' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:02.915563 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp76710f07-a15c-4b0d-91a2-eb2fa5f044da' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:02.924074 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.023458 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.141044 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb6d83b19-4fd5-462a-a236-0667ede1cc8c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:03.145711 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.145844 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpeb7430fa-35fc-4025-a676-f4ac5f12fcb6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:03.159915 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.170965 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.206123 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7de2ae20-60e7-4a2a-8485-ff579cf8d6a5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:03.209598 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.221945 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp8288bf7f-41fd-4ab8-9481-40fe6475e652' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:03.239297 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.250498 [ 2196 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp4f67ab10-48d2-4b1b-b4f0-b5cf3976b569' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:03.255922 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.264387 [ 11408 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.268683 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5160832 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.378217 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp51b4cd47-f647-496a-a9f5-df5626f73505' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:03.379443 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp17a15687-4287-4b55-a016-c19cb65e81e8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:03.400665 [ 11408 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.411408 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.440505 [ 2023 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.440900 [ 2032 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.441333 [ 2106 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.455285 [ 2069 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.455584 [ 2002 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.456702 [ 2084 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.481513 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.575163 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc3d62eb1-1391-4145-a8c6-b39bc663f5bf' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:03.577799 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp228c8c93-5791-4f1f-ab61-23ceeb628d89' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:03.583819 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.588183 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.629766 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.636037 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp0c3ddff8-c5c2-4c8c-b8a1-aba111d4aa18' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:03.636285 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4220522 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.669552 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.738683 [ 2193 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpc6b320bb-1162-47c6-b9fc-2222a931cd0d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:03.743281 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.752975 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5051508 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.863041 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc027ea1e-94fc-44eb-9370-94083f4c0898' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:03.863170 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp2a92dcb3-4f9f-482b-b912-c11b050e4513' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:03.866313 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.868702 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.879235 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4207868 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:03.955527 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp74fdccf8-55e0-4438-a130-c024bcdb951b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:03.999562 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp8412546d-3973-420b-892d-84055daeaa6f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:04.199930 [ 11992 ] {0b0c46d7-aecd-44e9-9c3b-202d7f523987} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048975 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46112) (comment: 02534_s3_cluster_insert_select_schema_inference.sql) (in query: insert into test select * from s3Cluster('test_cluster_one_shard_three_replicas_localhost', 'http://localhost:11111/test/a.tsv');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:0: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x0000000034bfaee7 in /usr/bin/clickhouse 12. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::forceConnected(DB::ConnectionTimeouts const&) @ 0x0000000034c0443b in /usr/bin/clickhouse 13. ./build_docker/./src/Client/ConnectionEstablisher.cpp:51: DB::ConnectionEstablisher::run(PoolWithFailoverBase::TryResult&, String&) @ 0x0000000034c523f2 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ConnectionPoolWithFailover::tryGetEntry(DB::IConnectionPool&, DB::ConnectionTimeouts const&, String&, DB::Settings const*, DB::QualifiedTableName const*, std::function) @ 0x0000000034c39141 in /usr/bin/clickhouse 15. ./build_docker/./src/Client/ConnectionPoolWithFailover.cpp:121: PoolWithFailoverBase::TryResult std::__function::__policy_invoker::TryResult (DB::IConnectionPool&, String&)>::__call_impl, std::optional)::$_0, PoolWithFailoverBase::TryResult (DB::IConnectionPool&, String&)>>(std::__function::__policy_storage const*, DB::IConnectionPool&, String&) @ 0x0000000034c3a6a7 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: PoolWithFailoverBase::getMany(unsigned long, unsigned long, unsigned long, unsigned long, bool, std::function::TryResult (DB::IConnectionPool&, String&)> const&, std::function const&) @ 0x0000000034c3cd62 in /usr/bin/clickhouse 17. ./build_docker/./src/Client/ConnectionPoolWithFailover.cpp:210: DB::ConnectionPoolWithFailover::getManyImpl(DB::Settings const*, DB::PoolMode, std::function::TryResult (DB::IConnectionPool&, String&)> const&, std::optional) @ 0x0000000034c382df in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ConnectionPoolWithFailover::getMany(DB::ConnectionTimeouts const&, DB::Settings const*, DB::PoolMode, std::function, std::optional) @ 0x0000000034c379a7 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/IStorageCluster.cpp:97: DB::IStorageCluster::read(std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032cd2beb in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/IStorage.cpp:144: DB::IStorage::read(DB::QueryPlan&, std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032cc21d9 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:2486: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000031538d65 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031526e5b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/IInterpreterUnionOrSelectQuery.cpp:28: DB::IInterpreterUnionOrSelectQuery::buildQueryPipeline(DB::QueryPlan&) @ 0x00000000314b9b0e in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/IInterpreterUnionOrSelectQuery.cpp:22: DB::IInterpreterUnionOrSelectQuery::buildQueryPipeline() @ 0x00000000314b98e1 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314aeabf in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 2024.10.22 00:34:04.255588 [ 2307 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5182505 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ca0bd9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:04.255796 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:04.255896 [ 11992 ] {0b0c46d7-aecd-44e9-9c3b-202d7f523987} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048975 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:0: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x0000000034bfaee7 in /usr/bin/clickhouse 12. ./build_docker/./src/Client/Connection.cpp:0: DB::Connection::forceConnected(DB::ConnectionTimeouts const&) @ 0x0000000034c0443b in /usr/bin/clickhouse 13. ./build_docker/./src/Client/ConnectionEstablisher.cpp:51: DB::ConnectionEstablisher::run(PoolWithFailoverBase::TryResult&, String&) @ 0x0000000034c523f2 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ConnectionPoolWithFailover::tryGetEntry(DB::IConnectionPool&, DB::ConnectionTimeouts const&, String&, DB::Settings const*, DB::QualifiedTableName const*, std::function) @ 0x0000000034c39141 in /usr/bin/clickhouse 15. ./build_docker/./src/Client/ConnectionPoolWithFailover.cpp:121: PoolWithFailoverBase::TryResult std::__function::__policy_invoker::TryResult (DB::IConnectionPool&, String&)>::__call_impl, std::optional)::$_0, PoolWithFailoverBase::TryResult (DB::IConnectionPool&, String&)>>(std::__function::__policy_storage const*, DB::IConnectionPool&, String&) @ 0x0000000034c3a6a7 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: PoolWithFailoverBase::getMany(unsigned long, unsigned long, unsigned long, unsigned long, bool, std::function::TryResult (DB::IConnectionPool&, String&)> const&, std::function const&) @ 0x0000000034c3cd62 in /usr/bin/clickhouse 17. ./build_docker/./src/Client/ConnectionPoolWithFailover.cpp:210: DB::ConnectionPoolWithFailover::getManyImpl(DB::Settings const*, DB::PoolMode, std::function::TryResult (DB::IConnectionPool&, String&)> const&, std::optional) @ 0x0000000034c382df in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/vector:666: DB::ConnectionPoolWithFailover::getMany(DB::ConnectionTimeouts const&, DB::Settings const*, DB::PoolMode, std::function, std::optional) @ 0x0000000034c379a7 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/IStorageCluster.cpp:97: DB::IStorageCluster::read(std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032cd2beb in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/IStorage.cpp:144: DB::IStorage::read(DB::QueryPlan&, std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x0000000032cc21d9 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:2486: DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&) @ 0x0000000031538d65 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:1444: DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::optional) @ 0x0000000031526e5b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/optional:260: DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) @ 0x000000003152493c in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) @ 0x00000000316e47d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/IInterpreterUnionOrSelectQuery.cpp:28: DB::IInterpreterUnionOrSelectQuery::buildQueryPipeline(DB::QueryPlan&) @ 0x00000000314b9b0e in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/IInterpreterUnionOrSelectQuery.cpp:22: DB::IInterpreterUnionOrSelectQuery::buildQueryPipeline() @ 0x00000000314b98e1 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314aeabf in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 31. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 2024.10.22 00:34:04.270235 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:04.541300 [ 2001 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:04.541664 [ 2102 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:04.542256 [ 2096 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:04.548664 [ 2022 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:04.559385 [ 2087 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:04.559725 [ 2020 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:05.548115 [ 1996 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:05.548522 [ 2080 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:05.548779 [ 2040 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:05.560074 [ 2078 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:05.572005 [ 2057 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:05.574155 [ 2068 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:06.182012 [ 12113 ] {} TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:32: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x000000002e2d4fef in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges&, DB::SettingSource) const @ 0x000000002f94f2c3 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:1704: DB::TCPHandler::receiveQuery() @ 0x0000000034f06780 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x0000000034eec063 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed58db in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:06.550381 [ 2010 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:06.550704 [ 2013 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:06.550939 [ 2077 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:06.561810 [ 2076 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:06.574900 [ 2009 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:06.576988 [ 2055 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:07.153113 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} void DB::CachedOnDiskWriteBufferFromFile::cacheData(char *, size_t, bool): Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1343551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:103: DB::FileSegmentRangeWriter::write(char const*, unsigned long, unsigned long, DB::FileSegmentKind) @ 0x000000002ddd35b2 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:257: DB::CachedOnDiskWriteBufferFromFile::cacheData(char*, unsigned long, bool) @ 0x000000002ddd7e06 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:0: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x000000002ddd7442 in /usr/bin/clickhouse 17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x000000002dddb48b in /usr/bin/clickhouse 18. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x0000000033cb7df4 in /usr/bin/clickhouse 19. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000bdd68e8 in /usr/bin/clickhouse 20. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:0: DB::CompressedWriteBuffer::nextImpl() @ 0x000000002ec7b6ad in /usr/bin/clickhouse 21. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x0000000033cb7df4 in /usr/bin/clickhouse 22. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker::__call_impl, std::allocator>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419e42b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 25. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set, std::allocator>&) @ 0x0000000034193fd8 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_map:1805: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set, std::allocator>&, std::vector> const&) @ 0x00000000341918dd in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x000000003418debf in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x00000000345c1f17 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f272 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:07.506549 [ 2241 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 5178461 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c726b9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c701a6 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d963a79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:07.506681 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 2392127 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory>::resize(unsigned long) @ 0x000000001d74f0a4 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::WriteBufferFromS3::reallocateFirstBuffer() @ 0x000000002e5d2ecd in /usr/bin/clickhouse 11. ./build_docker/./src/IO/BufferBase.h:40: DB::WriteBufferFromS3::nextImpl() @ 0x000000002e5d1e88 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBuffer.h:60: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x000000002ddd754b in /usr/bin/clickhouse 13. ./build_docker/./src/IO/WriteBuffer.h:60: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x000000002dddb48b in /usr/bin/clickhouse 14. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x0000000033cb7df4 in /usr/bin/clickhouse 15. DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000bdd68e8 in /usr/bin/clickhouse 16. ./build_docker/./src/Compression/CompressedWriteBuffer.cpp:0: DB::CompressedWriteBuffer::nextImpl() @ 0x000000002ec7b6ad in /usr/bin/clickhouse 17. ./build_docker/./src/IO/WriteBuffer.h:60: DB::HashingWriteBuffer::nextImpl() @ 0x0000000033cb7df4 in /usr/bin/clickhouse 18. ./build_docker/./src/IO/WriteBuffer.h:60: void std::__function::__policy_invoker::__call_impl, std::allocator>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419e42b in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set, std::allocator>&) @ 0x0000000034193fd8 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/unordered_map:1805: DB::MergeTreeDataPartWriterWide::writeColumn(DB::NameAndTypePair const&, DB::IColumn const&, std::set, std::allocator>&, std::vector> const&) @ 0x00000000341918dd in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:251: DB::MergeTreeDataPartWriterWide::write(DB::Block const&, DB::PODArray, 63ul, 64ul> const*) @ 0x000000003418debf in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:327: DB::MergedBlockOutputStream::write(DB::Block const&) @ 0x00000000345c1f17 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f272 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:07.506471 [ 12113 ] {393839a0-eb1a-4e0c-bd06-e469c0e0948f} executeQuery: Code: 41. DB::ParsingException: Cannot read DateTime: unexpected date: 2024-2-55: While processing parseDateTime64BestEffort('2.55'). (CANNOT_PARSE_DATETIME) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46298) (comment: 01424_parse_date_time_bad_date.sql) (in query: select parseDateTime64BestEffort('2.55');), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ParsingException::ParsingException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned short&, unsigned short&&, unsigned short&&) @ 0x000000001d79b07d in /usr/bin/clickhouse 3. ./build_docker/./src/IO/parseDateTimeBestEffort.cpp:98: void DB::(anonymous namespace)::parseDateTimeBestEffortImpl(long&, DB::ReadBuffer&, DateLUTImpl const&, DateLUTImpl const&, DB::(anonymous namespace)::DateTimeSubsecondPart*) @ 0x000000001d77d0e6 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/parseDateTimeBestEffort.cpp:664: DB::parseDateTime64BestEffort(DB::DateTime64&, unsigned int, DB::ReadBuffer&, DateLUTImpl const&, DateLUTImpl const&) @ 0x000000001d7984f6 in /usr/bin/clickhouse 5. COW::immutable_ptr DB::ConvertThroughParsing::execute(std::vector> const&, std::shared_ptr const&, unsigned long, unsigned int) @ 0x000000000d2cca2b in /usr/bin/clickhouse 6. DB::FunctionConvertFromString::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000d2c7fa9 in /usr/bin/clickhouse 7. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 13. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 2024.10.22 00:34:07.542964 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:07.543315 [ 2559 ] {fe5f1d94-2a63-431c-9a58-a8ab94bd88b1} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1697806 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/ndj/ygiwxjgydppmtwlaxmahalklehtxw, hash key: 35ca43204d7d9c554f18c49c9dcd89f0, file_offset_of_buffer_end: 0, read_until_position: 49528, internal buffer end: 49528, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: fe5f1d94-2a63-431c-9a58-a8ab94bd88b1:12376, file segment info: File segment: [0, 49527], key: 35ca43204d7d9c554f18c49c9dcd89f0, state: DOWNLOADING, downloaded size: 0, reserved size: 49528, downloader id: fe5f1d94-2a63-431c-9a58-a8ab94bd88b1:12376, current write offset: 0, caller id: fe5f1d94-2a63-431c-9a58-a8ab94bd88b1:12376, kind: Regular, unbound: 0: (while reading column StartDate): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/84f/84f788e2-4f4e-45fa-bf6b-97219cb78fa2/201403_1_1_0/ in table test.visits (84f788e2-4f4e-45fa-bf6b-97219cb78fa2) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 39064): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46242) (comment: 00040_aggregating_materialized_view.sql) (in query: CREATE MATERIALIZED VIEW test.basic_00040 ENGINE = AggregatingMergeTree(StartDate, (CounterID, StartDate), 8192) POPULATE AS SELECT CounterID, StartDate, sumState(Sign) AS Visits, uniqState(UserID) AS Users FROM test.visits GROUP BY CounterID, StartDate;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/tuple:533: DB::AsynchronousBoundedReadBuffer::nextImpl() @ 0x000000002dd1f0ef in /usr/bin/clickhouse 20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x000000002ec749b2 in /usr/bin/clickhouse 21. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec795a1 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f215c44 in /usr/bin/clickhouse 23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 2024.10.22 00:34:07.543352 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1254156 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/memcpySmall.h:40: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x00000000326f2a83 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Merges/Algorithms/MergedData.h:33: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl>(DB::SortingQueueImpl&) @ 0x0000000035af6890 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::SortingQueueImpl, DB::SortingQueueImpl>&>(std::__variant_detail::__visitation::__variant::__value_visitor&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::SortingQueueImpl, DB::SortingQueueImpl>&) @ 0x0000000035a6e937 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/variant:637: DB::MergingSortedAlgorithm::merge() @ 0x0000000035a61456 in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform::work() @ 0x0000000031b27a83 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 27. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:07.543537 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1995965 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/84f/84f788e2-4f4e-45fa-bf6b-97219cb78fa2/201403_6_6_0/ in table test.visits (84f788e2-4f4e-45fa-bf6b-97219cb78fa2) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6826): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:07.543593 [ 12113 ] {393839a0-eb1a-4e0c-bd06-e469c0e0948f} TCPHandler: Code: 41. DB::ParsingException: Cannot read DateTime: unexpected date: 2024-2-55: While processing parseDateTime64BestEffort('2.55'). (CANNOT_PARSE_DATETIME), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ParsingException::ParsingException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned short&, unsigned short&&, unsigned short&&) @ 0x000000001d79b07d in /usr/bin/clickhouse 3. ./build_docker/./src/IO/parseDateTimeBestEffort.cpp:98: void DB::(anonymous namespace)::parseDateTimeBestEffortImpl(long&, DB::ReadBuffer&, DateLUTImpl const&, DateLUTImpl const&, DB::(anonymous namespace)::DateTimeSubsecondPart*) @ 0x000000001d77d0e6 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/parseDateTimeBestEffort.cpp:664: DB::parseDateTime64BestEffort(DB::DateTime64&, unsigned int, DB::ReadBuffer&, DateLUTImpl const&, DateLUTImpl const&) @ 0x000000001d7984f6 in /usr/bin/clickhouse 5. COW::immutable_ptr DB::ConvertThroughParsing::execute(std::vector> const&, std::shared_ptr const&, unsigned long, unsigned int) @ 0x000000000d2cca2b in /usr/bin/clickhouse 6. DB::FunctionConvertFromString::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000d2c7fa9 in /usr/bin/clickhouse 7. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 8. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 11. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 12. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 13. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 2024.10.22 00:34:07.652668 [ 1987 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:07.653056 [ 1997 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:07.653581 [ 2051 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:07.653811 [ 1995 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:07.654384 [ 1997 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:07.654614 [ 1979 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:07.711160 [ 2559 ] {fe5f1d94-2a63-431c-9a58-a8ab94bd88b1} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1697806 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: Cache info: Buffer path: common/ndj/ygiwxjgydppmtwlaxmahalklehtxw, hash key: 35ca43204d7d9c554f18c49c9dcd89f0, file_offset_of_buffer_end: 0, read_until_position: 49528, internal buffer end: 49528, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: fe5f1d94-2a63-431c-9a58-a8ab94bd88b1:12376, file segment info: File segment: [0, 49527], key: 35ca43204d7d9c554f18c49c9dcd89f0, state: DOWNLOADING, downloaded size: 0, reserved size: 49528, downloader id: fe5f1d94-2a63-431c-9a58-a8ab94bd88b1:12376, current write offset: 0, caller id: fe5f1d94-2a63-431c-9a58-a8ab94bd88b1:12376, kind: Regular, unbound: 0: (while reading column StartDate): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/84f/84f788e2-4f4e-45fa-bf6b-97219cb78fa2/201403_1_1_0/ in table test.visits (84f788e2-4f4e-45fa-bf6b-97219cb78fa2) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 39064): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 17. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 18. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::readInto(char*, unsigned long, unsigned long, unsigned long) @ 0x000000002dd26d38 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/tuple:533: DB::AsynchronousBoundedReadBuffer::nextImpl() @ 0x000000002dd1f0ef in /usr/bin/clickhouse 20. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x000000002ec749b2 in /usr/bin/clickhouse 21. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:110: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x000000002ec795a1 in /usr/bin/clickhouse 22. ./build_docker/./src/DataTypes/Serializations/SerializationNumber.cpp:160: DB::SerializationNumber::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f215c44 in /usr/bin/clickhouse 23. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 2024.10.22 00:34:08.040213 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp6ca29774-ed5a-4fdb-98e5-1d019b166b92' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:08.043390 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:08.116494 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp4b50b136-c0bd-496f-af1e-093c72d843dc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:08.132291 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:08.150761 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:08.185940 [ 2197 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpf7f32469-1f64-4c64-a987-d0479cdd29d5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:08.281632 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 2097152 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: While executing MergingSortedTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:0: DB::CompressedWriteBuffer::nextImpl() @ 0x000000002ec7b869 in /usr/bin/clickhouse 10. DB::WriteBuffer::write(char) @ 0x000000000c6c080c in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Merges/Algorithms/MergingSortedAlgorithm.cpp:188: DB::IMergingAlgorithm::Status DB::MergingSortedAlgorithm::mergeImpl>(DB::SortingQueueImpl&) @ 0x0000000035af8cc9 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/variant:548: decltype(auto) std::__variant_detail::__visitation::__base::__dispatcher<25ul>::__dispatch[abi:v15000]&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::SortingQueueImpl, DB::SortingQueueImpl>&>(std::__variant_detail::__visitation::__variant::__value_visitor&&, std::__variant_detail::__base<(std::__variant_detail::_Trait)1, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::UUIDTag>>>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl>, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, (DB::SortingQueueStrategy)0>, DB::SortingQueueImpl, DB::SortingQueueImpl, DB::SortingQueueImpl>&) @ 0x0000000035a6e937 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/variant:637: DB::MergingSortedAlgorithm::merge() @ 0x0000000035a61456 in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Chunk.h:90: DB::IMergingTransform::work() @ 0x0000000031b27a83 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 27. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:08.287908 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:08.362004 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpe72eec64-3fef-48b9-b738-2cfe7e1f544a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:08.369749 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:08.563579 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpde479f64-34ef-4ec0-9c2e-dfa8ce4ceb6d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:08.686517 [ 2190 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp5c498ec7-2c6f-4d20-ae0b-1cbaf894a53d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:08.741630 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 4889629 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031ceb946 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d96ae39 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:08.741783 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:08.741991 [ 2086 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:08.742108 [ 2017 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:08.742277 [ 1990 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:08.742327 [ 1975 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:08.742652 [ 1998 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:08.742767 [ 2019 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:08.750290 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:08.750424 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:08.830773 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpf8974f6c-1c23-4b7a-b09a-a1e5c3102532' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:08.943948 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpbb2fae1f-6fd4-4a44-9f7f-3d4b4e38296c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.008656 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.008880 [ 11408 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.008830 [ 11891 ] {8c66ef28-4ab5-4e9b-9099-ff1bbef76dfb} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46344) (comment: 01455_optimize_trivial_insert_select.sql) (in query: -- For trivial INSERT SELECT, max_threads is lowered to max_insert_threads and max_block_size is changed to min_insert_block_size_rows. INSERT INTO t SELECT * FROM numbers_mt(1000000);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::StripeLogSink::StripeLogSink(DB::StorageStripeLog&, std::shared_ptr const&, std::unique_lock&&) @ 0x0000000033774e76 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::StorageStripeLog::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000003375edcb in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Transforms/buildPushingToViewsChain.cpp:0: DB::buildPushingToViewsChain(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, bool, std::shared_ptr, std::shared_ptr, std::atomic*, bool, DB::Block const&) @ 0x000000003597e761 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:291: DB::InterpreterInsertQuery::buildSink(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::atomic*) @ 0x00000000314a79c7 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:534: DB::InterpreterInsertQuery::execute() @ 0x00000000314afcbd in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 24. ? @ 0x00007f11b339dac3 in ? 25. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:09.010474 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.011012 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.023867 [ 11891 ] {8c66ef28-4ab5-4e9b-9099-ff1bbef76dfb} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::StripeLogSink::StripeLogSink(DB::StorageStripeLog&, std::shared_ptr const&, std::unique_lock&&) @ 0x0000000033774e76 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:143: DB::StorageStripeLog::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000003375edcb in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Transforms/buildPushingToViewsChain.cpp:0: DB::buildPushingToViewsChain(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, bool, std::shared_ptr, std::shared_ptr, std::atomic*, bool, DB::Block const&) @ 0x000000003597e761 in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:291: DB::InterpreterInsertQuery::buildSink(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::atomic*) @ 0x00000000314a79c7 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:534: DB::InterpreterInsertQuery::execute() @ 0x00000000314afcbd in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 18. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 22. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 24. ? @ 0x00007f11b339dac3 in ? 25. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:09.026875 [ 14378 ] {4ec5c4c5-77ef-4e35-b63d-ee31523e1f98} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 02137_mv_into_join.sql) (in query: /* ddl_entry=query-0000000026 */ CREATE TABLE test_5.main UUID 'b75c75c3-2d21-4b18-b588-78b8f5262568' (`id` String, `color` String, `section` String, `description` String) ENGINE = MergeTree ORDER BY tuple() SETTINGS index_granularity = 54939, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 8, prefer_fetch_merged_part_size_threshold = 1897815348, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 10737418240, index_granularity_bytes = 30176684, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 59179, primary_key_compress_block_size = 18867), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 31. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 2024.10.22 00:34:09.092969 [ 2559 ] {ab8f1a6b-eed4-48bb-9e2b-38c0a5ebdb7d} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_23_23_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46364) (comment: 00089_position_functions_with_non_constant_arg.sql) (in query: SELECT count() FROM test.hits WHERE position(URL, 'metrika') != position(URL, materialize('metrika'));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 2024.10.22 00:34:09.131050 [ 2559 ] {ab8f1a6b-eed4-48bb-9e2b-38c0a5ebdb7d} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_23_23_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 2024.10.22 00:34:09.152937 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp68c44cac-ff7c-432b-b133-5cfb45fb2af3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.167323 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.175333 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7d1d7dee-eb9e-4a07-b28f-8863bce37683' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.175160 [ 14378 ] {4ec5c4c5-77ef-4e35-b63d-ee31523e1f98} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46380) (comment: 02137_mv_into_join.sql) (in query: CREATE TABLE main (`id` String, `color` String, `section` String, `description` String) ENGINE = MergeTree ORDER BY tuple() SETTINGS index_granularity = 54939, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 1., merge_max_block_size = 8, prefer_fetch_merged_part_size_threshold = 1897815348, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 10737418240, index_granularity_bytes = 30176684, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 59179, primary_key_compress_block_size = 18867), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 31. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 2024.10.22 00:34:09.215368 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.230101 [ 14378 ] {4ec5c4c5-77ef-4e35-b63d-ee31523e1f98} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 31. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 2024.10.22 00:34:09.269048 [ 2195 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpba4b53cb-4fd0-495a-acc8-23b4ead7894f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.277929 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.284240 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp4c754b69-0e30-4b73-b32d-e220a73b0870' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.284608 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpfdd538db-c523-494f-a2c8-201467e9fdf9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.337635 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.338285 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.432009 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp112fd73d-d487-4691-977e-189c29a28340' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.443769 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp207c2475-a68f-4cfd-a824-efc0fd3d439b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.452685 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.453054 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.536950 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 5160832 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.579953 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp9750c92b-d331-48be-b960-d6c899d58320' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.585504 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.586152 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp0fb2427a-8c7d-4058-8f14-78a276f27dc7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.590303 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.617502 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpb0af0b6e-19c2-44ae-9208-93d47192d630' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.620505 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.642069 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.740369 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpa78b2455-1c4b-4f1b-99ea-4a1f227b8fc1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.742783 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.744565 [ 2088 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.745056 [ 2054 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.745522 [ 2028 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.746225 [ 2037 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.747493 [ 1992 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.757286 [ 2090 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.804750 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.817021 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 4265578 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.839342 [ 11408 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.868890 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 5039076 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.873418 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp99f9f5cf-c741-4bbe-a372-f6c01fd5e230' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.875966 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.884704 [ 2187 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpda9cdf53-412b-42f0-acb3-74b7ce09e1fd' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.888111 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7b796975-9637-4d0a-995f-dc5131b50600' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.888168 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.893201 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.918555 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp6a5cc9b0-9cda-4cdd-8b3e-425bf0d7b008' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.924780 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.950657 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 5197367 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031cccb46 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d9693f9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.952304 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp37c3369c-46f2-432d-bd4d-6f61b3d24e14' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.962540 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:09.994657 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd859efb6-547c-4da1-b0c9-2cf7ceecbdc4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:09.999807 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.005484 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpa2aabbe1-40c6-4397-b4b0-5e4c57900869' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.018975 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.049462 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpde5db921-d2c4-48ce-9210-76ea059291fb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.056653 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.081114 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp7d6be61b-202b-4a2b-8a75-ab083ea08412' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.085858 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.137207 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe4ba6d92-416d-41e2-b467-a4237cd145a3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.224340 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.234231 [ 2307 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 5186601 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ca0bd9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.235421 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp116ddba7-40f6-4c7d-a01a-af6168777ca1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.244347 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.275419 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd826abb5-a57a-4ef6-b798-28ecebefd46f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.291837 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.300782 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp1b09a544-8279-4ebc-a5b4-89d08a948c56' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.319787 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.327514 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.359819 [ 2191 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpf659817f-9f7b-4562-9779-b6b16eb616a4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.372950 [ 2310 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 5165377 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cbf959 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.375733 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.434251 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp823beaee-d5ec-4b97-bf73-36385d67c114' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.439061 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpcc21dd12-71f1-4a13-a23e-1877f59b263b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.544646 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.545999 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.578519 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp91299f57-7f33-4b4b-8883-b268e6fa2645' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.582233 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.680156 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.713493 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd3feb92b-cc38-41c7-8746-43e63f62ee0c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.715059 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp9231cf32-f3dd-4b92-a55d-52cde6c52316' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.716298 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.726454 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.746287 [ 2061 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.746511 [ 2059 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.747354 [ 2018 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.748734 [ 2059 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.749454 [ 2097 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.763943 [ 2097 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.766825 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpf3e56495-f945-404d-ba7c-24a4262ba703' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.766982 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp5fa409c1-5a1e-4701-8d3b-9aecbabae502' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.781767 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.792075 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.792622 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.892228 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp011e3425-19ad-44a9-9b7d-2e92812db3e9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.904846 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.909810 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp44eb12e0-1ac0-4cf9-8036-5d5dddf04143' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.913662 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.944578 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp602c7a62-ab31-469e-bfc9-82b103418b15' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.950244 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.953073 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp67dd5967-0225-4738-8390-e5d63a8192e9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.955285 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:10.978468 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpda1b1bca-b247-4698-b055-3380732bc7b0' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:10.983920 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.010676 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpb276fdbd-c948-4fd2-a709-1adfbe1a64f8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.023688 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.152005 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp10ed12f2-0e45-4bdb-b4ce-c3c89b22c5e4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.204303 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp5a6005a9-8d67-4047-bde0-28136c228cdc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.209714 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.222074 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.265027 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp61b69580-6daa-4c99-a238-6ea07f824cbb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.271747 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp589db7df-615e-407a-a7e7-aba9cbf58f91' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.287456 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.287454 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.287791 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.357669 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp2e89d20d-b361-413f-a0e6-2799b0efd926' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.369978 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.432445 [ 2187 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp0f8b1130-8712-45f9-8a5b-2e2569373889' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.444905 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.446286 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp1b496b39-48cd-4ca2-9497-83f2af4baf18' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.453976 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.514973 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp76d52d95-2f69-4f5b-8677-30a9d19f8d23' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.515965 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc000473b-2bea-4700-8441-1252ead399fa' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.525552 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.526933 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.554234 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp31631880-b09c-4369-87b4-6e99f7a73410' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.557479 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.561784 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp302f5c60-77a4-47b6-8eac-6d53572c082b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.575922 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.620959 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpbfd9080f-ffd9-42a2-a9bd-b859eb87f3fb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.626115 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.648153 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc1e32864-98f6-4744-9184-2bcbdda3e6a0' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.775070 [ 11891 ] {47a4cea9-8644-4f52-b9ff-6ed43aeb4e1e} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1499909 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ParsedParams.Key1): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_1_7_1/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 331 with max_rows_to_read = 32955): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37906) (comment: 00079_array_join_not_used_joined_column.sql) (in query: SELECT PP.Key1 AS `ym:s:paramsLevel1`, sum(arrayAll(`x_1` -> `x_1`= '', ParsedParams.Key2)) AS `ym:s:visits` FROM test.hits ARRAY JOIN ParsedParams AS `PP` WHERE CounterID = 1704509 GROUP BY `ym:s:paramsLevel1` ORDER BY PP.Key1, `ym:s:visits` LIMIT 0, 100;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd8d085 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:141: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f161638 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 25. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 28. ? @ 0x00007f11b339dac3 in ? 29. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:11.784738 [ 2031 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.784780 [ 1988 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.785092 [ 2107 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.785203 [ 1995 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.785229 [ 2051 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.784922 [ 1987 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.785946 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.827366 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.841174 [ 11408 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.855340 [ 11891 ] {47a4cea9-8644-4f52-b9ff-6ed43aeb4e1e} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1499909 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column ParsedParams.Key1): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_1_7_1/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 331 with max_rows_to_read = 32955): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd8d085 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationArray.cpp:141: DB::SerializationArray::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f161638 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 12. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 13. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 25. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 28. ? @ 0x00007f11b339dac3 in ? 29. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:11.869232 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe6bbe2dc-cf6f-4851-93c3-9d7cf1d82bbb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.907274 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.934193 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpd807d6d6-66cb-4365-8f1c-19e02e42a850' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.938720 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:11.990786 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpeef6992a-2b2c-4425-8b0c-fcf66a1d58f2' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:11.990946 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpef05bf7c-0fe8-4758-81d0-66c9d41566a5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:12.013464 [ 2193 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp94b41eb0-d907-4aa3-aeb6-0eb39179d797' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:12.106365 [ 11405 ] {} TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:32: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x000000002e2d4fef in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges&, DB::SettingSource) const @ 0x000000002f94f2c3 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:1704: DB::TCPHandler::receiveQuery() @ 0x0000000034f06780 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x0000000034eec063 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed58db in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:12.107032 [ 2559 ] {908598cf-f156-47af-834e-3f324b855dfd} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION concat('string: ' :: 2, toString(number) :: 3) -> concat('string: ', toString(number)) String : 1'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37968) (comment: 02122_parallel_formatting_PrettySpace.sh) (in query: select number, number + 1, concat('string: ', toString(number)) from numbers(200000) format PrettySpace), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. DB::GatherUtils::StringSink::reserve(unsigned long) @ 0x00000000102d01d7 in /usr/bin/clickhouse 10. void DB::GatherUtils::concat, DB::GatherUtils::StringSource, DB::GatherUtils::StringSink>(DB::GatherUtils::ConstSource&&, DB::GatherUtils::StringSource&&, DB::GatherUtils::StringSink&&) @ 0x00000000102cf8bd in /usr/bin/clickhouse 11. DB::(anonymous namespace)::ConcatImpl::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000102c5c6c in /usr/bin/clickhouse 12. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:12.109480 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.109941 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.115717 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.117086 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.117917 [ 2559 ] {908598cf-f156-47af-834e-3f324b855dfd} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 1572864 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: while executing 'FUNCTION concat('string: ' :: 2, toString(number) :: 3) -> concat('string: ', toString(number)) String : 1'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. DB::GatherUtils::StringSink::reserve(unsigned long) @ 0x00000000102d01d7 in /usr/bin/clickhouse 10. void DB::GatherUtils::concat, DB::GatherUtils::StringSource, DB::GatherUtils::StringSink>(DB::GatherUtils::ConstSource&&, DB::GatherUtils::StringSource&&, DB::GatherUtils::StringSink&&) @ 0x00000000102cf8bd in /usr/bin/clickhouse 11. DB::(anonymous namespace)::ConcatImpl::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000102c5c6c in /usr/bin/clickhouse 12. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 14. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 15. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 25. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 27. ? @ 0x00007f11b339dac3 in ? 28. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:12.211367 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpf0cce4cc-4d3b-47af-a9d9-16548ec0d397' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:12.215692 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.320995 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp7906cc0b-69da-4fe0-8e5e-514ca2ba189b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:12.325912 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.430565 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp5e716628-cf60-41fd-8a1e-ae1e358fe76e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:12.434534 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.501903 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpfae57b8c-9e8f-47ee-8bdd-96d17c004c36' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:12.504721 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.629246 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp2217be0e-ab9a-4aad-8b2f-4406df398e8a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:12.639855 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp836d1cd4-2e58-468c-a26b-f1ecae6b7736' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:12.639711 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.643348 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.783810 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe57c92b8-d687-47ed-805b-6458fef5cc69' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:12.783837 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpe1d8185c-3408-4cd7-b9f7-94e5e3dbb948' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:12.786439 [ 1998 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.786924 [ 2095 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.787805 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.788131 [ 2059 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.788162 [ 2029 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.788583 [ 2097 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.788925 [ 2006 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.794463 [ 2185 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp93ed55bb-2c87-4c18-8adc-733d4fa9be73' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:12.954015 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.954256 [ 11843 ] {6ae9ae59-7c8a-4fff-ba28-a655e36e4bdd} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1210488 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: while executing 'FUNCTION toString(number : 0) -> toString(number) String : 3'. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38084) (comment: 02122_parallel_formatting_PrettySpace.sh) (in query: select number, number + 1, concat('string: ', toString(number)) from numbers(200000) format PrettySpace), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd8d085 in /usr/bin/clickhouse 10. DB::ConvertImpl, DB::DataTypeString, DB::NameToString, DB::ConvertDefaultBehaviorTag>::execute(std::vector> const&, std::shared_ptr const&, unsigned long) @ 0x000000000c69a26e in /usr/bin/clickhouse 11. bool DB::callOnIndexAndDataType::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c690fa1 in /usr/bin/clickhouse 12. DB::FunctionConvert::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c68e793 in /usr/bin/clickhouse 13. DB::FunctionConvert::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c68c52a in /usr/bin/clickhouse 14. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 17. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:12.967602 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.968626 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:12.974827 [ 11843 ] {6ae9ae59-7c8a-4fff-ba28-a655e36e4bdd} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1210488 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: while executing 'FUNCTION toString(number : 0) -> toString(number) String : 3'. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. void DB::PODArrayBase<8ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bd8d085 in /usr/bin/clickhouse 10. DB::ConvertImpl, DB::DataTypeString, DB::NameToString, DB::ConvertDefaultBehaviorTag>::execute(std::vector> const&, std::shared_ptr const&, unsigned long) @ 0x000000000c69a26e in /usr/bin/clickhouse 11. bool DB::callOnIndexAndDataType::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, auto const&)&, DB::ConvertDefaultBehaviorTag>(DB::TypeIndex, auto&&, DB::ConvertDefaultBehaviorTag&&) @ 0x000000000c690fa1 in /usr/bin/clickhouse 12. DB::FunctionConvert::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c68e793 in /usr/bin/clickhouse 13. DB::FunctionConvert::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000c68c52a in /usr/bin/clickhouse 14. DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8728c in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ca5e in /usr/bin/clickhouse 16. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 17. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 18. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x000000002fc6f150 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Transforms/ExpressionTransform.cpp:0: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x00000000357c3a89 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:35: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x000000002673f67e in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/ISimpleTransform.cpp:99: DB::ISimpleTransform::work() @ 0x0000000034fcefcd in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:96: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000035027307 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 29. ? @ 0x00007f11b339dac3 in ? 30. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:12.975683 [ 2241 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 5187165 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c726b9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c701a6 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d963a79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.064632 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 4657890 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.123864 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.199604 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp3934fed5-a364-4c4f-a028-3a43fe6be37f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:13.207247 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 4432130 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c62f99 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.220033 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.285133 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.314948 [ 11405 ] {3c9fd788-f021-4a97-896c-ced94b3a91e2} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1049903 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 02493_max_streams_for_merge_tree_reading.sql) (in query: /* ddl_entry=query-0000000027 */ CREATE TABLE test_5.t UUID 'bbeb68cb-7985-4f85-95cc-75dc561bdcdb' (`x` UInt64) ENGINE = MergeTree ORDER BY x), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:13.316354 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 4734749 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031ceb946 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d96ae39 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.433265 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp4b07c8fe-bd32-48a3-a2c0-8b204b8ed2a4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:13.435723 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.443415 [ 11405 ] {3c9fd788-f021-4a97-896c-ced94b3a91e2} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1049903 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38100) (comment: 02493_max_streams_for_merge_tree_reading.sql) (in query: create table t (x UInt64) engine = MergeTree order by x;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:13.463200 [ 11405 ] {3c9fd788-f021-4a97-896c-ced94b3a91e2} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1049903 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:13.526828 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.546648 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb8b96f24-d36d-4dc7-8a56-29e0bb387a8a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:13.549781 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.568100 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpb8ddb894-11f8-4b9f-9f6e-5b9607115f18' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:13.576921 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.586314 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd4b458be-f460-49b4-93dc-792ad0a3badd' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:13.594257 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.608369 [ 2495 ] {3035c96c-c0cf-45c3-b53e-473f47e2d768} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1734776 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38126) (comment: 02122_parallel_formatting_PrettySpace.sh) (in query: select number, number + 1, concat('string: ', toString(number)) from numbers(200000) group by number with totals order by number limit 190000 format PrettySpace), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d53a447 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/HashTable/HashTable.h:0: HashTable, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>::resize(unsigned long, unsigned long) @ 0x00000000300b4c37 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/HashTable/HashTable.h:307: void DB::Aggregator::executeImplBatch, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>>(DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>&, DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const @ 0x00000000301cb03d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::executeImpl, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>>(DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>&, DB::Arena*, unsigned long, unsigned long, std::vector>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000002ff5e700 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeImpl(DB::AggregatedDataVariants&, unsigned long, unsigned long, std::vector>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000002fda3e8c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/Aggregator.cpp:1593: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdabf57 in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 20. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:13.623869 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp3586a134-4a29-4db5-ad7b-fa7aa2dfe719' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:13.647299 [ 2495 ] {3035c96c-c0cf-45c3-b53e-473f47e2d768} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1734776 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d53a447 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/HashTable/HashTable.h:0: HashTable, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>::resize(unsigned long, unsigned long) @ 0x00000000300b4c37 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/HashTable/HashTable.h:307: void DB::Aggregator::executeImplBatch, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>>(DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>&, DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const @ 0x00000000301cb03d in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::executeImpl, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>>(DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>&, DB::Arena*, unsigned long, unsigned long, std::vector>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000002ff5e700 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeImpl(DB::AggregatedDataVariants&, unsigned long, unsigned long, std::vector>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000002fda3e8c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/Aggregator.cpp:1593: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdabf57 in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 20. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:13.668527 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.674526 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.796002 [ 1982 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.796654 [ 2098 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.797109 [ 2088 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.800640 [ 2054 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.811035 [ 2028 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.811697 [ 1992 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.886225 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp3fc728f1-8e06-4e8b-b3dc-f45ef1a734c0' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:13.890083 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.911256 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpf43d10b1-43fc-4a6e-a94b-ecfedb929a35' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:13.917032 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.920649 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpea6a8efd-3357-4a28-98f0-5a6ddcb168f6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:13.930488 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:13.991614 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp0ae230ff-dd4e-4ef0-b311-74f2a10dc176' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:14.009538 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:14.572280 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 5160832 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:14.573203 [ 11843 ] {b0d14e5c-52ba-4df4-b875-96cef03bee57} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 17201272 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38162) (comment: 02122_parallel_formatting_PrettySpace.sh) (in query: select number, number + 1, concat('string: ', toString(number)) from numbers(200000) group by number with totals order by number limit 190000 format PrettySpace), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d53a447 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/HashTable/HashTable.h:0: HashTable, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>::resize(unsigned long, unsigned long) @ 0x00000000300b4c37 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/HashTable/HashTable.h:307: void DB::Aggregator::executeImplBatch, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>>(DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>&, DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const @ 0x00000000301c98fd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::executeImpl, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>>(DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>&, DB::Arena*, unsigned long, unsigned long, std::vector>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000002ff5e6c5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeImpl(DB::AggregatedDataVariants&, unsigned long, unsigned long, std::vector>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000002fda3e8c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/Aggregator.cpp:1593: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdabf57 in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 20. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:14.729655 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1114301 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:14.729688 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1114301 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:14.730167 [ 11843 ] {b0d14e5c-52ba-4df4-b875-96cef03bee57} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 17201272 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d53a447 in /usr/bin/clickhouse 9. ./build_docker/./src/Common/HashTable/HashTable.h:0: HashTable, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>::resize(unsigned long, unsigned long) @ 0x00000000300b4c37 in /usr/bin/clickhouse 10. ./build_docker/./src/Common/HashTable/HashTable.h:307: void DB::Aggregator::executeImplBatch, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>>(DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>&, DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>::State&, DB::Arena*, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*) const @ 0x00000000301c98fd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/Aggregator.cpp:0: void DB::Aggregator::executeImpl, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>>(DB::AggregationMethodOneNumber, HashTableNoState, PairNoInit>, HashCRC32, HashTableGrowerWithPrecalculation<8ul>, Allocator>, true, false>&, DB::Arena*, unsigned long, unsigned long, std::vector>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000002ff5e6c5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeImpl(DB::AggregatedDataVariants&, unsigned long, unsigned long, std::vector>&, DB::Aggregator::AggregateFunctionInstruction*, bool, char*) const @ 0x000000002fda3e8c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/Aggregator.cpp:1593: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdabf57 in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 15. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 16. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 18. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 19. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 20. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 21. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 23. ? @ 0x00007f11b339dac3 in ? 24. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:14.730249 [ 2495 ] {88e2f679-cbae-4448-9f8d-00c43b43388f} executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38194) (comment: 02674_trivial_count_analyzer.sql) (in query: -- { echoOn } set allow_experimental_analyzer=1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:14.747805 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:14.748403 [ 2495 ] {88e2f679-cbae-4448-9f8d-00c43b43388f} TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:14.797917 [ 2079 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:14.798540 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:84: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b5bc in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:14.799362 [ 1999 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:14.800483 [ 2025 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:14.801796 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 4220522 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:14.802238 [ 2025 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:14.813480 [ 2066 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:14.824100 [ 1993 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:14.848916 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1192139 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading from part /var/lib/clickhouse/disks/s3/store/3aa/3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f/202410_100_100_0/ in table system.text_log (3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 1262): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:101: DB::Memory>::resize(unsigned long) @ 0x000000001d74f0a4 in /usr/bin/clickhouse 10. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:0: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec7854e in /usr/bin/clickhouse 11. ./build_docker/./src/IO/ReadBuffer.h:72: void DB::deserializeBinarySSE2<1>(DB::PODArray, 63ul, 64ul>&, DB::PODArray, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x000000002f282da8 in /usr/bin/clickhouse 12. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27dda3 in /usr/bin/clickhouse 13. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeReaderCompact::readData(DB::NameAndTypePair const&, COW::immutable_ptr&, unsigned long, unsigned long, unsigned long, unsigned long, std::optional>) @ 0x0000000034413473 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderCompact.cpp:234: DB::MergeTreeReaderCompact::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x0000000034411539 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 19. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 20. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 21. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 22. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.002113 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:84: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b5bc in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.053835 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1114301 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 23. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.086652 [ 11408 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.105752 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpbe22163b-7e84-4ce1-9e44-8d6fd9f02f4c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:15.110623 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.120783 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp2346690f-9629-4891-8432-08e75618a356' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:15.124401 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.133754 [ 2559 ] {82951d44-7691-40d6-95d7-81723627e0a5} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38048) (comment: 00031_array_enumerate_uniq.sql) (in query: SELECT UserID, arrayEnumerateUniq(groupArray(SearchPhrase)) AS arr FROM ( SELECT UserID, SearchPhrase FROM test.hits WHERE CounterID = 1704509 AND UserID IN ( SELECT UserID FROM test.hits WHERE notEmpty(SearchPhrase) AND CounterID = 1704509 GROUP BY UserID HAVING count() > 1 ) ORDER BY UserID, WatchID ) WHERE notEmpty(SearchPhrase) GROUP BY UserID HAVING length(arr) > 1 ORDER BY UserID LIMIT 20 ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:15.163308 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpcf519222-6b09-45ff-9b48-ce961b20ca51' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:15.167315 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.195019 [ 2559 ] {82951d44-7691-40d6-95d7-81723627e0a5} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:669: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000003574b5d9 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744f71 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 14. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 15. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 16. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:15.275813 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpbf5b02be-8267-46a6-b264-b9282bb859fd' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:15.358066 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.382051 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp31c8ea91-23a0-4c8c-adf4-5dbadab16595' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:15.445738 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc5e31448-60ba-4da9-b3e5-79d212f7132b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:15.451923 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.490281 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.497852 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.521002 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp5f914708-7b75-43a2-87b0-67c4e9e19f2a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:15.532518 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.543431 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpca16e1ce-ba20-449a-99fd-b55e6d1ef939' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:15.548082 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.550501 [ 11405 ] {847faf6a-0656-4706-bfc7-09fbc96466dc} executeQuery: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38208) (comment: 02370_analyzer_in_function.sql) (in query: SET allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:15.568925 [ 2190 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpc4994f02-80be-4690-8a98-558d6f04e3d3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:15.574984 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp411239bd-a02a-402d-ac19-f5fe820d1162' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:15.582485 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.582536 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.604828 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp03b3803a-49ac-42aa-ae49-91a4eb48f5d0' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:15.608154 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.633893 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp90866379-d8b1-4239-a530-be12f4a009fd' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:15.652304 [ 11405 ] {847faf6a-0656-4706-bfc7-09fbc96466dc} TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:100: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002e2d4ea3 in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges const&, DB::SettingSource) const @ 0x000000002f93bb03 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterSetQuery::execute() @ 0x00000000316ec011 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:15.735049 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5155383 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031cccb46 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d9693f9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.744443 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.744681 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.800445 [ 2052 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.802361 [ 2045 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.802655 [ 1976 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.804715 [ 2045 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.828759 [ 1985 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.829186 [ 2094 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.869316 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp69f945e9-0c06-45ab-b7ff-cee8324dc74b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:15.880936 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:15.905613 [ 2307 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5182505 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ca0bd9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.066554 [ 2199 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp3cafacf7-b69c-4f15-a00a-d244ec697eb3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:16.068383 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7b8138af-c410-42a9-bc1d-8df47acb2876' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:16.081660 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.081926 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.084921 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp0e210fc0-0a39-4031-80df-f9bf384d3471' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:16.089214 [ 11408 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.096173 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.145023 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp27000e84-0a00-4981-801e-6f0a8b8c3a20' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:16.147670 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.160028 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.162485 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp1b0d83cb-c47d-41e3-b619-5cef765d3401' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:16.171358 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.228706 [ 2310 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 5165249 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cbf959 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.281029 [ 3272 ] {8ebd2858-a2bc-4cb8-bb49-277a7a9fbc7c} AsynchronousInsertQueue: Failed parsing for query 'INSERT INTO test_7.t_json_async_insert FORMAT JSONAsObject' with query id 436ca4b0-1b61-45f2-badb-92291014796e. DB::Exception: Cannot parse object: (at row 1) 2024.10.22 00:34:16.292072 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmpa12fcbad-87fa-47a7-b1b3-1494a34d7e57' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:16.309075 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp4c5ef207-38f0-44a4-aeb0-c636be6b940a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:16.345866 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.345815 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.346400 [ 12113 ] {436ca4b0-1b61-45f2-badb-92291014796e} executeQuery: Code: 117. DB::Exception: Cannot parse object: (at row 1) : While executing WaitForAsyncInsert. (INCORRECT_DATA) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46388) (comment: 02421_type_json_async_insert.sh) (in query: INSERT INTO t_json_async_insert FORMAT JSONAsObject ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/DataTypes/Serializations/SerializationObject.cpp:58: void DB::SerializationObject>::deserializeTextImpl>::deserializeTextJSON(DB::IColumn&, DB::ReadBuffer&, DB::FormatSettings const&) const::'lambda'(String&)>(DB::IColumn&, DB::SerializationObject>::deserializeTextJSON(DB::IColumn&, DB::ReadBuffer&, DB::FormatSettings const&) const::'lambda'(String&)&&) const @ 0x000000002f25b5ac in /usr/bin/clickhouse 4. ./build_docker/./src/DataTypes/Serializations/SerializationObject.cpp:122: DB::SerializationObject>::deserializeTextJSON(DB::IColumn&, DB::ReadBuffer&, DB::FormatSettings const&) const @ 0x000000002f24b49e in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Formats/Impl/JSONAsStringRowInputFormat.cpp:0: DB::JSONAsRowInputFormat::readRow(std::vector::mutable_ptr, std::allocator::mutable_ptr>>&, DB::RowReadExtension&) @ 0x000000003533b14e in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x0000000035167db7 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/StreamingFormatExecutor.cpp:60: DB::StreamingFormatExecutor::execute() @ 0x0000000035035229 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/StreamingFormatExecutor.cpp:45: DB::StreamingFormatExecutor::execute(DB::ReadBuffer&) @ 0x0000000035034b1e in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.cpp:0: DB::AsynchronousInsertQueue::processData(DB::AsynchronousInsertQueue::InsertQuery, std::unique_ptr>, std::shared_ptr) @ 0x000000002f8a9ea8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.h:50: void std::__function::__policy_invoker::__call_impl>, std::shared_ptr)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000002f8b1cf5 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:16.363216 [ 12113 ] {436ca4b0-1b61-45f2-badb-92291014796e} TCPHandler: Code: 117. DB::Exception: Cannot parse object: (at row 1) : While executing WaitForAsyncInsert. (INCORRECT_DATA), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/DataTypes/Serializations/SerializationObject.cpp:58: void DB::SerializationObject>::deserializeTextImpl>::deserializeTextJSON(DB::IColumn&, DB::ReadBuffer&, DB::FormatSettings const&) const::'lambda'(String&)>(DB::IColumn&, DB::SerializationObject>::deserializeTextJSON(DB::IColumn&, DB::ReadBuffer&, DB::FormatSettings const&) const::'lambda'(String&)&&) const @ 0x000000002f25b5ac in /usr/bin/clickhouse 4. ./build_docker/./src/DataTypes/Serializations/SerializationObject.cpp:122: DB::SerializationObject>::deserializeTextJSON(DB::IColumn&, DB::ReadBuffer&, DB::FormatSettings const&) const @ 0x000000002f24b49e in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Formats/Impl/JSONAsStringRowInputFormat.cpp:0: DB::JSONAsRowInputFormat::readRow(std::vector::mutable_ptr, std::allocator::mutable_ptr>>&, DB::RowReadExtension&) @ 0x000000003533b14e in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x0000000035167db7 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/StreamingFormatExecutor.cpp:60: DB::StreamingFormatExecutor::execute() @ 0x0000000035035229 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/StreamingFormatExecutor.cpp:45: DB::StreamingFormatExecutor::execute(DB::ReadBuffer&) @ 0x0000000035034b1e in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.cpp:0: DB::AsynchronousInsertQueue::processData(DB::AsynchronousInsertQueue::InsertQuery, std::unique_ptr>, std::shared_ptr) @ 0x000000002f8a9ea8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.h:50: void std::__function::__policy_invoker::__call_impl>, std::shared_ptr)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000002f8b1cf5 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:16.473187 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.526648 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb92de062-97f5-48ea-9ba4-7bb4f7680642' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:16.550140 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.625609 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmped2698ff-ef97-44e5-b652-f7bed74ce5ed' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:16.643361 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.747003 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpf173e37f-bbc6-4667-9cb5-88b4beaad389' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:16.787235 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.802380 [ 2051 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.802512 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp3175d833-796c-4830-a672-ff1f7d68cd34' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:16.805450 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.805680 [ 1987 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.805927 [ 2062 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.806381 [ 1997 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.830723 [ 1978 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.831008 [ 2039 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.845248 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:16.960535 [ 11405 ] {92f9a85d-b63c-4ae8-98cc-3974ff589d24} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:16.991331 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb7786f32-fee0-4b00-abcf-ed50ffc7a294' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:17.011585 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.018690 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp564f1e2e-8a0e-4a93-9e67-9634db94f04a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:17.026890 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.032562 [ 11850 ] {131b0e58-30a5-437a-b82c-245562bfdc5e} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.032716 [ 11851 ] {f5db9c47-06de-48f5-aa42-35d8fd8dfce2} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.178623 [ 11851 ] {f5db9c47-06de-48f5-aa42-35d8fd8dfce2} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38302) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE dst_2 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/dst', '2') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.178582 [ 11850 ] {131b0e58-30a5-437a-b82c-245562bfdc5e} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38304) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE dst_5 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/dst', '5') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.253916 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb280a379-a6e2-40c9-9697-155a526b0089' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:17.253949 [ 11850 ] {131b0e58-30a5-437a-b82c-245562bfdc5e} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.258286 [ 2194 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp57d54f25-dbad-492c-8ab7-8f9e60211826' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:17.259836 [ 11851 ] {f5db9c47-06de-48f5-aa42-35d8fd8dfce2} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.328858 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.355149 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp011028cc-36f2-4c2e-bb63-0c513d50cbab' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:17.359870 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.407851 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.469016 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp92e84202-d876-4eea-8aab-a12dbb2fe8fd' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:17.481633 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpcb430a3e-1f58-4b9d-b22c-df33e474dfb4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:17.486219 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.513879 [ 1911 ] {0e2f9c5c-f3a0-46c1-8f29-e1afe4cb1b1c} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.599635 [ 11424 ] {cf57a37a-47f4-45ba-944d-9db0f72ad395} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.608906 [ 12062 ] {84f37e9a-8d12-4649-b7a6-68809978c076} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.610121 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.611097 [ 1911 ] {0e2f9c5c-f3a0-46c1-8f29-e1afe4cb1b1c} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38320) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE dst_4 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/dst', '4') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.612271 [ 11424 ] {cf57a37a-47f4-45ba-944d-9db0f72ad395} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38336) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE dst_3 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/dst', '3') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.615194 [ 11424 ] {cf57a37a-47f4-45ba-944d-9db0f72ad395} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.624202 [ 11880 ] {182ebf62-4e5b-400f-9211-243f57757194} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.626514 [ 12062 ] {84f37e9a-8d12-4649-b7a6-68809978c076} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38366) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE dst_12 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/dst', '12') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.631328 [ 1911 ] {0e2f9c5c-f3a0-46c1-8f29-e1afe4cb1b1c} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.655241 [ 11864 ] {9e4fc715-04dd-4cb6-b218-c519088249f8} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.658064 [ 12062 ] {84f37e9a-8d12-4649-b7a6-68809978c076} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.660079 [ 11880 ] {182ebf62-4e5b-400f-9211-243f57757194} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38356) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE dst_13 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/dst', '13') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.693583 [ 11880 ] {182ebf62-4e5b-400f-9211-243f57757194} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.723897 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp9c7d09ae-2bc7-4ed1-a8db-60205ec26374' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:17.739020 [ 11419 ] {4b8d4632-7fa2-4800-bafa-8b8061eb0aae} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.739275 [ 11869 ] {08c86da2-94f3-496f-a79a-b2fd96175f16} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.744051 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.744584 [ 11864 ] {9e4fc715-04dd-4cb6-b218-c519088249f8} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38422) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE dst_15 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/dst', '15') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.745633 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe83152e3-ef66-47ef-b52b-3f8adc8de33c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:17.752680 [ 11864 ] {9e4fc715-04dd-4cb6-b218-c519088249f8} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.766255 [ 11851 ] {2a742341-58fe-4923-a31c-863590c2072c} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.766383 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.770104 [ 11887 ] {9209e136-b024-41a7-863e-e0cc60ea9ea9} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.770576 [ 11886 ] {3d54cfb7-8c61-4828-9717-882f45016f70} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.772401 [ 2694 ] {7bf9a9d9-c85f-4230-9156-859d2592a70a} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.772435 [ 11392 ] {3f3285a3-dca5-491a-bddb-3d6edc15e084} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.772569 [ 11867 ] {6042a05d-4136-40c8-a1ba-d9425f4bdf8b} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.773187 [ 11851 ] {2a742341-58fe-4923-a31c-863590c2072c} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38572) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE dst_7 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/dst', '7') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.774317 [ 2694 ] {7bf9a9d9-c85f-4230-9156-859d2592a70a} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38378) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE dst_0 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/dst', '0') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.774372 [ 11887 ] {9209e136-b024-41a7-863e-e0cc60ea9ea9} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38402) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE dst_10 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/dst', '10') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.776407 [ 11395 ] {76040ef9-0d55-4717-b2e5-b40afb0643d5} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.777293 [ 11867 ] {6042a05d-4136-40c8-a1ba-d9425f4bdf8b} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38436) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE dst_14 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/dst', '14') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.783175 [ 11851 ] {2a742341-58fe-4923-a31c-863590c2072c} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.784324 [ 11392 ] {3f3285a3-dca5-491a-bddb-3d6edc15e084} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38478) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE dst_1 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/dst', '1') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.785080 [ 2694 ] {7bf9a9d9-c85f-4230-9156-859d2592a70a} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.791788 [ 11886 ] {3d54cfb7-8c61-4828-9717-882f45016f70} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38414) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE dst_9 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/dst', '9') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.792617 [ 11978 ] {3989db62-76cb-402c-8db3-c7ba33ff6624} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.794085 [ 11861 ] {95bb6d0d-dce3-4f55-9e50-4e74e9a2c402} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.794259 [ 11395 ] {76040ef9-0d55-4717-b2e5-b40afb0643d5} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38502) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE dst_8 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/dst', '8') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.794414 [ 11887 ] {9209e136-b024-41a7-863e-e0cc60ea9ea9} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.804336 [ 11867 ] {6042a05d-4136-40c8-a1ba-d9425f4bdf8b} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.804217 [ 11392 ] {3f3285a3-dca5-491a-bddb-3d6edc15e084} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.804455 [ 2038 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.811451 [ 11886 ] {3d54cfb7-8c61-4828-9717-882f45016f70} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.811440 [ 11861 ] {95bb6d0d-dce3-4f55-9e50-4e74e9a2c402} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38386) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE dst_6 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/dst', '6') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.811519 [ 11978 ] {3989db62-76cb-402c-8db3-c7ba33ff6624} executeQuery: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38558) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE dst_11 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/dst', '11') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.811989 [ 2018 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.812853 [ 2029 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.814384 [ 11395 ] {76040ef9-0d55-4717-b2e5-b40afb0643d5} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.822281 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpd86b2f70-220d-4231-aa9b-659897516ac2' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:17.822411 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.827266 [ 1998 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.831602 [ 11978 ] {3989db62-76cb-402c-8db3-c7ba33ff6624} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.837639 [ 11861 ] {95bb6d0d-dce3-4f55-9e50-4e74e9a2c402} TCPHandler: Code: 80. DB::Exception: Explicit zookeeper_path and replica_name are specified in ReplicatedMergeTree arguments. If you really want to specify it explicitly, then you should use some macros to distinguish different shards and replicas. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [211]) @ 0x000000002f3d3ee9 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::checkQueryValid(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002f391be4 in /usr/bin/clickhouse 4. ./build_docker/./src/Databases/DatabaseReplicated.cpp:698: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f392dd6 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:17.839060 [ 2059 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.840652 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.846772 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp0c6be885-4a56-49b2-b97a-cf50fe502433' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:17.861156 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 4657890 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.869280 [ 2653 ] {01637169-4e33-41ac-af29-d7d669a81a27} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.869224 [ 11839 ] {4eb2a166-2e27-478c-9efa-887b0f2c6a38} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.870337 [ 11870 ] {4832da62-b275-4060-9f1d-ad7995bf9142} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.869027 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.877587 [ 3735 ] {3e056f7f-e3a2-4224-809b-6f0262294a78} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.877951 [ 11850 ] {dc7799e9-fd1e-49e1-8cb9-54c92ebcc243} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.878228 [ 11877 ] {45a81bf4-c91b-49be-9dab-a0a7e773a375} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.912169 [ 3877 ] {d65ef796-5886-4c5f-9c69-fdc36e98228e} DatabaseReplicated (test_5): It's not recommended to explicitly specify zookeeper_path and replica_name in ReplicatedMergeTree arguments 2024.10.22 00:34:17.934655 [ 2190 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpba5695b6-6586-459b-8b44-ad61326f5018' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:17.935913 [ 2057 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:17.944423 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:18.008967 [ 3746 ] {1962a46f-7626-45aa-a02e-debce799a246} executeQuery: Code: 131. DB::Exception: Too large string size in function randomPrintableASCII: While processing randomPrintableASCII(nan). (TOO_LARGE_STRING_SIZE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38608) (comment: 01054_random_printable_ascii_ubsan.sh) (in query: SELECT randomPrintableASCII(nan);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionRandomPrintableASCII::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a686f8d in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 2024.10.22 00:34:18.158541 [ 11405 ] {92f9a85d-b63c-4ae8-98cc-3974ff589d24} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01154_move_partition_long.sh) (in query: /* ddl_entry=query-0000000028 */ CREATE TABLE test_5.src_7 UUID '949c83c0-bddb-4e31-9da4-62add46658fc' (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/{shard}/src', concat('{replica}_', toString(randConstant()))) PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:18.184705 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:18.259478 [ 3746 ] {1962a46f-7626-45aa-a02e-debce799a246} TCPHandler: Code: 131. DB::Exception: Too large string size in function randomPrintableASCII: While processing randomPrintableASCII(nan). (TOO_LARGE_STRING_SIZE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionRandomPrintableASCII::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a686f8d in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 2024.10.22 00:34:18.260845 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x00000000341744a5 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:18.293056 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x00000000341744a5 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:18.365901 [ 11405 ] {92f9a85d-b63c-4ae8-98cc-3974ff589d24} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38270) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE src_7 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/{shard}/src', concat('{replica}_', toString(randConstant()))) PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:18.368412 [ 11405 ] {92f9a85d-b63c-4ae8-98cc-3974ff589d24} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:18.669909 [ 3746 ] {} TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:32: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x000000002e2d4fef in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges&, DB::SettingSource) const @ 0x000000002f94f2c3 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:1704: DB::TCPHandler::receiveQuery() @ 0x0000000034f06780 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x0000000034eec063 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed58db in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:18.700456 [ 3737 ] {7575fae0-8ac2-4dc5-9546-d26c0497a865} executeQuery: Code: 131. DB::Exception: Too large string size in function randomPrintableASCII: While processing randomPrintableASCII(inf). (TOO_LARGE_STRING_SIZE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38684) (comment: 01054_random_printable_ascii_ubsan.sh) (in query: SELECT randomPrintableASCII(inf);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionRandomPrintableASCII::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a686f8d in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 2024.10.22 00:34:18.702509 [ 3737 ] {7575fae0-8ac2-4dc5-9546-d26c0497a865} TCPHandler: Code: 131. DB::Exception: Too large string size in function randomPrintableASCII: While processing randomPrintableASCII(inf). (TOO_LARGE_STRING_SIZE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionRandomPrintableASCII::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a686f8d in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 2024.10.22 00:34:18.750491 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x0000000034174046 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:18.814196 [ 1981 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:18.814303 [ 1983 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:18.814615 [ 2011 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:18.832822 [ 2053 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:18.840560 [ 2010 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:18.921406 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1062170 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero.: (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_9_9_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::ReadBufferFromFileBase::ReadBufferFromFileBase(unsigned long, char*, unsigned long, std::optional) @ 0x000000001d7011c7 in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a250 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:347: DB::ReadBuffer* std::__function::__policy_invoker::__call_impl const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool)::$_0, DB::ReadBuffer* (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003444937d in /usr/bin/clickhouse 20. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:129: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141df0 in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:0: DB::MergeTreeSequentialSource::generate() @ 0x0000000034450384 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x0000000035029676 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PullingPipelineExecutor.cpp:65: DB::PullingPipelineExecutor::pull(DB::Block&) @ 0x0000000035029e1a in /usr/bin/clickhouse 31. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:436: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() @ 0x0000000033e9f1f8 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:18.937735 [ 2098 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:18.962323 [ 2187 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpff702664-65c0-4f77-b637-4dc334ad3521' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:18.964474 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp0c20bca2-66bb-4fdf-a8e3-67f7f1295444' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:18.968968 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:18.969080 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:18.971236 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpfb29e8c7-9638-4b80-8d5d-96226f8e6e77' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:18.993407 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.025246 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpce80fd5f-d209-4a69-ba0e-7fb9223b2c54' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:19.031284 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.151536 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpafa7e626-a92f-41a1-97a5-ee6d6aaf29bc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:19.285081 [ 11891 ] {8ae3aca9-c7db-4935-9187-cd18f36f1ecf} executeQuery: Code: 131. DB::Exception: Too large string size in function randomPrintableASCII: While processing randomPrintableASCII(-inf). (TOO_LARGE_STRING_SIZE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56968) (comment: 01054_random_printable_ascii_ubsan.sh) (in query: SELECT randomPrintableASCII(-inf);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionRandomPrintableASCII::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a686f8d in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 2024.10.22 00:34:19.285272 [ 2559 ] {a6e63ca7-4b6c-4786-accf-c301360e0be3} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1318644 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_23_23_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38252) (comment: 00095_hyperscan_profiler.sql) (in query: SELECT count() FROM test.hits WHERE multiFuzzyMatchAny(URL, 2, ['about/address', 'for_woman', '^https?://lm-company.ruy/$', 'ultimateguitar.com']);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray, 63ul, 64ul>&, DB::PODArray, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x000000002f2832c7 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27dda3 in /usr/bin/clickhouse 12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 27. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:19.285797 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.287705 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.298506 [ 11891 ] {8ae3aca9-c7db-4935-9187-cd18f36f1ecf} TCPHandler: Code: 131. DB::Exception: Too large string size in function randomPrintableASCII: While processing randomPrintableASCII(-inf). (TOO_LARGE_STRING_SIZE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionRandomPrintableASCII::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a686f8d in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 2024.10.22 00:34:19.300016 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.319850 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp60b60b8b-c479-4624-810e-279e2212ad7f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:19.327067 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.348229 [ 2559 ] {a6e63ca7-4b6c-4786-accf-c301360e0be3} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1318644 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_23_23_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray, 63ul, 64ul>&, DB::PODArray, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x000000002f2832c7 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27dda3 in /usr/bin/clickhouse 12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 26. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 27. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 28. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 30. ? @ 0x00007f11b339dac3 in ? 31. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:19.361931 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpe186b4e2-0612-495f-aa79-f4712f074e86' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:19.376618 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.616443 [ 2241 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 4269474 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c726b9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.644508 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1054909 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterOnDisk::Stream::Stream(String const&, std::shared_ptr const&, String const&, String const&, String const&, String const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&, unsigned long, DB::WriteSettings const&) @ 0x00000000341744a5 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&>(String&, std::shared_ptr&&, String&, char const* const&, String&, String const&, std::shared_ptr&, unsigned long const&, std::shared_ptr&, unsigned long const&, DB::WriteSettings const&) @ 0x00000000341a4773 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:119: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x000000003419cd9f in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 24. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003418bd34 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b81f in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.674537 [ 11851 ] {86d88c94-dc55-4b6d-8157-2abbbdc793ba} executeQuery: Code: 131. DB::Exception: Too large string size in function randomPrintableASCII: While processing randomPrintableASCII(1e300). (TOO_LARGE_STRING_SIZE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56986) (comment: 01054_random_printable_ascii_ubsan.sh) (in query: SELECT randomPrintableASCII(1e300);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionRandomPrintableASCII::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a686f8d in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 2024.10.22 00:34:19.699358 [ 11851 ] {86d88c94-dc55-4b6d-8157-2abbbdc793ba} TCPHandler: Code: 131. DB::Exception: Too large string size in function randomPrintableASCII: While processing randomPrintableASCII(1e300). (TOO_LARGE_STRING_SIZE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionRandomPrintableASCII::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a686f8d in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 2024.10.22 00:34:19.704525 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e9011b in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 19. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 20. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 22. ? @ 0x00007f11b339dac3 in ? 23. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.704545 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp091854f1-f60d-42ce-9a35-fc1223b12c2b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:19.705404 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 4423682 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c62f99 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.707529 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.777368 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 30. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 31. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.816012 [ 2066 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.816422 [ 2042 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.816834 [ 1993 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.834465 [ 2082 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.841893 [ 2085 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.877108 [ 12137 ] {cea2a3a3-7ba3-4af2-8d8b-5a96c0fa4b0c} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1053759 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01154_move_partition_long.sh) (in query: /* ddl_entry=query-0000000031 */ CREATE TABLE test_5.src_3 UUID '1b2d2bf3-1e01-45dc-af91-e8189e17fdbf' (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = MergeTree PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:19.897176 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 4596450 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.923694 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:84: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b5bc in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.948077 [ 2026 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:19.903113 [ 12137 ] {cea2a3a3-7ba3-4af2-8d8b-5a96c0fa4b0c} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1053759 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38454) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE src_3 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = MergeTree PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:20.024645 [ 12137 ] {cea2a3a3-7ba3-4af2-8d8b-5a96c0fa4b0c} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1053759 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:20.053916 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:84: DB::MergeTreeDataPartWriterWide::MergeTreeDataPartWriterWide(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003418b5bc in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartWide::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003414d0f4 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.054120 [ 2185 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp599ca9d0-5571-4a8c-9eff-655bf565bc70' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.057952 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.070605 [ 11862 ] {3169a45a-ed3d-4ba1-9e13-93b4100fc460} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1053759 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01154_move_partition_long.sh) (in query: /* ddl_entry=query-0000000032 */ CREATE TABLE test_5.src_15 UUID 'a7be9bab-71fc-4aba-b050-95a51556948e' (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = MergeTree PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:20.089793 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmpe1c88223-031c-4d33-99ee-b32d2618be71' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.092509 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.097006 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp5b09587a-02dc-458f-a435-a77cb17e3551' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.100700 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.110255 [ 11891 ] {f78b18d5-71a7-4c16-adad-ea672fe47463} executeQuery: Code: 131. DB::Exception: Too large string size in function randomPrintableASCII: While processing randomPrintableASCII(-123.456). (TOO_LARGE_STRING_SIZE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57016) (comment: 01054_random_printable_ascii_ubsan.sh) (in query: SELECT randomPrintableASCII(-123.456);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionRandomPrintableASCII::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a686f8d in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 2024.10.22 00:34:20.114221 [ 11891 ] {f78b18d5-71a7-4c16-adad-ea672fe47463} TCPHandler: Code: 131. DB::Exception: Too large string size in function randomPrintableASCII: While processing randomPrintableASCII(-123.456). (TOO_LARGE_STRING_SIZE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionRandomPrintableASCII::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a686f8d in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 2024.10.22 00:34:20.135184 [ 11862 ] {3169a45a-ed3d-4ba1-9e13-93b4100fc460} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1053759 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38452) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE src_15 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = MergeTree PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:20.154879 [ 11862 ] {3169a45a-ed3d-4ba1-9e13-93b4100fc460} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1053759 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:20.172519 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp69a23f57-7790-4b1f-81d5-d5642f85d25a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.175678 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.239706 [ 2187 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp83fdb75a-2043-47da-b66a-c6293b533015' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.245422 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.256184 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp628fd0c5-ead6-4623-9ae3-f1e56c5a769a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.259337 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.271995 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp0cefa0f7-008e-40d1-b956-34d1f8a310e5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.273762 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.310530 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp69fcd7d6-bcca-4c64-ba04-43af72deef37' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.318156 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.323170 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp90cec622-4c10-45bd-b5ec-c8309cd0272b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.325498 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.329741 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.380882 [ 11837 ] {15211980-40b0-4efd-a44d-c17cc88ba8d0} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1053759 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01154_move_partition_long.sh) (in query: /* ddl_entry=query-0000000033 */ CREATE TABLE test_5.src_6 UUID '1dde5675-fb44-4331-aeb9-de93ec7b66f3' (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = MergeTree PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:20.405975 [ 11837 ] {15211980-40b0-4efd-a44d-c17cc88ba8d0} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1053759 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38376) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE src_6 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = MergeTree PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:20.420113 [ 11837 ] {15211980-40b0-4efd-a44d-c17cc88ba8d0} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1053759 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:20.453003 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp755aabfb-187f-4ea1-9820-741b5ca186d6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.463294 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.471405 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 5160832 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.479077 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpfc69ae8a-7671-4b0a-b652-76f1798f7c71' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.483624 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.528643 [ 11851 ] {11cd3033-031b-4250-b97b-eb618b04f25f} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56998) (comment: 00139_like.sql) (in query: /* Note that queries are written as the user doesn't really understand that the symbol _ has special meaning in LIKE pattern. */ SELECT count() FROM test.hits WHERE URL LIKE '%/avtomobili_s_probegom/_%__%__%__%';), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a5a2 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker::__call_impl const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034448e97 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034443992 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x0000000034443033 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344442df in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 2024.10.22 00:34:20.551237 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpf9859832-63b7-466c-b4d9-6b16cd627b12' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.552580 [ 11851 ] {11cd3033-031b-4250-b97b-eb618b04f25f} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/7a5/7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef/201403_24_24_0/ in table test.hits (7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::AsynchronousBoundedReadBuffer::AsynchronousBoundedReadBuffer(std::unique_ptr>, DB::IAsynchronousReader&, DB::ReadSettings const&, std::shared_ptr, std::shared_ptr) @ 0x000000002dd1a5a2 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::S3ObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f505989 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:77: DB::CachedObjectStorage::readObjects(std::vector> const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002ddcd5d1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:496: DB::DiskObjectStorage::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002f52ff24 in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:122: DB::DataPartStorageOnDiskFull::readFile(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x0000000033cc9665 in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:120: DB::MergeTreeReaderStream::init() @ 0x000000003443aa94 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderStream.cpp:276: DB::MergeTreeReaderStream::adjustRightMark(unsigned long) @ 0x000000003443f412 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:278: DB::getStream(bool, DB::ISerialization::SubstreamPath const&, std::map>, std::less, std::allocator>>>>&, DB::NameAndTypePair const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034448917 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: void std::__function::__policy_invoker::__call_impl const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034448e97 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 21. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x0000000034443992 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:111: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x0000000034443033 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:0: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344442df in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x00000000344a91ca in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3c81 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 30. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 2024.10.22 00:34:20.556713 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp8477db58-d903-4127-a60a-ff972766e46d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.557474 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.562423 [ 11992 ] {90e1614c-e746-4e01-a844-9b853968be25} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048975 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38646) (comment: 02867_null_lc_in_bug.sql) (in query: CREATE TABLE tlc (`lc` LowCardinality(Nullable(String))) ENGINE = MergeTree ORDER BY tuple() SETTINGS index_granularity = 16603, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 3546, prefer_fetch_merged_part_size_threshold = 1, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 26, min_merge_bytes_to_use_direct_io = 6220640268, index_granularity_bytes = 24365073, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 17082, primary_key_compress_block_size = 40619), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:34:20.563786 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.564740 [ 11992 ] {90e1614c-e746-4e01-a844-9b853968be25} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048975 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 28. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 29. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 2024.10.22 00:34:20.610846 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4220522 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.624420 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpf5e8c3fd-ba22-4a83-8e2e-33cfb2c431b7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.657263 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.657423 [ 11419 ] {4b8d4632-7fa2-4800-bafa-8b8061eb0aae} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01154_move_partition_long.sh) (in query: /* ddl_entry=query-0000000034 */ CREATE TABLE test_5.src_8 UUID '54f59879-493e-4b2a-8f73-d08624eba0d9' (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree(concat('/test/01154_move_partition_long_test_5/{shard}/src_', toString(randConstant())), '{replica}') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:20.657847 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpf7616fef-8feb-4693-8345-218d74a9903a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.657898 [ 11408 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.666734 [ 11891 ] {e3e44fd2-b20d-407a-a59c-3d469bb1fcf3} executeQuery: Code: 131. DB::Exception: Too large string size in function randomPrintableASCII: While processing randomPrintableASCII(-1). (TOO_LARGE_STRING_SIZE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57036) (comment: 01054_random_printable_ascii_ubsan.sh) (in query: SELECT randomPrintableASCII(-1);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionRandomPrintableASCII::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a686f8d in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 2024.10.22 00:34:20.668707 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.669074 [ 11891 ] {e3e44fd2-b20d-407a-a59c-3d469bb1fcf3} TCPHandler: Code: 131. DB::Exception: Too large string size in function randomPrintableASCII: While processing randomPrintableASCII(-1). (TOO_LARGE_STRING_SIZE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::(anonymous namespace)::FunctionRandomPrintableASCII::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001a686f8d in /usr/bin/clickhouse 4. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 5. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 6. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 7. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 8. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 9. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 29. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 30. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 2024.10.22 00:34:20.692710 [ 11419 ] {4b8d4632-7fa2-4800-bafa-8b8061eb0aae} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38524) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE src_8 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree(concat('/test/01154_move_partition_long_test_5/{shard}/src_', toString(randConstant())), '{replica}') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:20.699099 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp2937c08f-6881-4e22-b0d2-84a9a1e89d85' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.710349 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpacbb131e-d4bd-4f23-8998-df7f10558cfb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.767773 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 5240621 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c53899 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c51386 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d961c79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.768096 [ 11419 ] {4b8d4632-7fa2-4800-bafa-8b8061eb0aae} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:20.769624 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.769617 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.817577 [ 2045 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.818232 [ 1985 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.825775 [ 2065 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.836666 [ 2094 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.844228 [ 1983 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.919029 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp08cc7510-40f9-4fa0-9913-bf6c10395a0b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.919989 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7ee43e84-0554-49cb-b66c-4d2b860f03aa' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.921476 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.924907 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.950791 [ 2075 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.963535 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.964540 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpcdbd1b1f-68da-4122-b85e-46eda15deaae' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.966383 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp3de5d6b5-7020-4c40-a47c-162ae9a66044' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:20.968875 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.970471 [ 11869 ] {08c86da2-94f3-496f-a79a-b2fd96175f16} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01154_move_partition_long.sh) (in query: /* ddl_entry=query-0000000035 */ CREATE TABLE test_5.src_10 UUID '10dc018c-7dc5-4d18-8b3a-eef034895b4e' (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/{shard}/src', concat('{replica}_', toString(randConstant()))) PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:20.971683 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:20.995847 [ 11869 ] {08c86da2-94f3-496f-a79a-b2fd96175f16} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38350) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE src_10 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/{shard}/src', concat('{replica}_', toString(randConstant()))) PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:21.001263 [ 11869 ] {08c86da2-94f3-496f-a79a-b2fd96175f16} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:21.043774 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7c83a449-7b64-4fd1-a034-a53947d0ff31' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.043906 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpbcd1b4a6-8e33-4b3e-986c-d552d6827784' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.140480 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.141082 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.168886 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp3b7e0734-fb90-4547-bfdd-9fda819adf74' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.171362 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.195353 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp99d14e3f-c952-4923-a899-607d7d131775' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.203636 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.284930 [ 2199 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpac70bb15-96e4-4dcf-b46a-30bc14ea4f15' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.286410 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4300028 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.296400 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.297615 [ 11841 ] {77daa04c-e7dc-4978-bc3d-c4cc6ff9cba3} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1053759 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01154_move_partition_long.sh) (in query: /* ddl_entry=query-0000000036 */ CREATE TABLE test_5.src_12 UUID 'c830f94a-4ae3-414f-82ad-eb1fdbf2580e' (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = MergeTree PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:21.298250 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp62b5b5ea-7fe0-45fb-8a66-2e25afdc9a8e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.301406 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.304117 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.326528 [ 11841 ] {77daa04c-e7dc-4978-bc3d-c4cc6ff9cba3} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1053759 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38506) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE src_12 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = MergeTree PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:21.330636 [ 11841 ] {77daa04c-e7dc-4978-bc3d-c4cc6ff9cba3} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1053759 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageMergeTree.cpp:116: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, bool, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool) @ 0x00000000348fa8ae in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, bool const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&) @ 0x00000000348f945b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed7fd in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:21.344873 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp08a1e7ed-65a1-4fa2-9112-a1ef54a7c90c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.351494 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd73fa64c-0d25-4c4c-b7a3-5ce56f6a484d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.352103 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.354071 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.388435 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpe3e5b010-2458-4c27-a981-4c69e3a0021a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.405678 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp8e7b9f3c-6d06-4216-a88a-f0264a5465e1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.405783 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.409840 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.461361 [ 2307 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 5197865 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ca0bd9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.535002 [ 2653 ] {01637169-4e33-41ac-af29-d7d669a81a27} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01154_move_partition_long.sh) (in query: /* ddl_entry=query-0000000037 */ CREATE TABLE test_5.src_2 UUID 'f33d3b15-e90a-48e0-b4e2-b76fb2236d9c' (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree(concat('/test/01154_move_partition_long_test_5/{shard}/src_', toString(randConstant())), '{replica}') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:21.578626 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp6797702b-c434-4587-afb9-4c5ed99a1b11' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.578763 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp2d91f58f-6ae0-4f33-a23c-52133b522db4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.582068 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.582153 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.587657 [ 2653 ] {01637169-4e33-41ac-af29-d7d669a81a27} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38516) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE src_2 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree(concat('/test/01154_move_partition_long_test_5/{shard}/src_', toString(randConstant())), '{replica}') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:21.590891 [ 2653 ] {01637169-4e33-41ac-af29-d7d669a81a27} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:21.623104 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp9594892e-b7b3-4181-9377-775a88ee91ec' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.634917 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.660690 [ 11408 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.726359 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.727765 [ 2310 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 5165377 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cbf959 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.773920 [ 2192 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp1edc4998-40dc-417b-bb21-18d2c2b0d4b3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.777502 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.865299 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpea7c45b6-7195-45d1-94c1-60dad8367213' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.867618 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.875227 [ 2070 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.875863 [ 2058 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.876369 [ 2026 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.887580 [ 2056 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.887953 [ 2096 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.896086 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpfb518991-74ca-4930-89bf-d661a2171268' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.907910 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.921137 [ 11839 ] {4eb2a166-2e27-478c-9efa-887b0f2c6a38} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01154_move_partition_long.sh) (in query: /* ddl_entry=query-0000000038 */ CREATE TABLE test_5.src_11 UUID 'e21d62a2-cf11-4f2d-baee-ded40ec42a19' (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree(concat('/test/01154_move_partition_long_test_5/{shard}/src_', toString(randConstant())), '{replica}') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:21.922028 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpecac8d4e-5e1d-44e5-a8b5-41f34d6603d1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:21.952770 [ 2074 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:21.958034 [ 11839 ] {4eb2a166-2e27-478c-9efa-887b0f2c6a38} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38528) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE src_11 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree(concat('/test/01154_move_partition_long_test_5/{shard}/src_', toString(randConstant())), '{replica}') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:21.960582 [ 11839 ] {4eb2a166-2e27-478c-9efa-887b0f2c6a38} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:22.025919 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.071278 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp1b58c37f-0878-4fb6-98f5-49c2167e80e9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:22.160821 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp78d658c1-7e23-4b02-a6a0-ce440943d052' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:22.225467 [ 2244 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousInsertLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4218589 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x00000000343d6317 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x00000000343d5adf in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:0: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x00000000345c6dbf in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x00000000345c4485 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:0: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ac548 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031d1c359 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031d19e46 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.226910 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.226986 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.349747 [ 3735 ] {3e056f7f-e3a2-4224-809b-6f0262294a78} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1088559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01154_move_partition_long.sh) (in query: /* ddl_entry=query-0000000039 */ CREATE TABLE test_5.src_14 UUID '495f9b3b-3cc3-4c53-8a2f-14efe563e662' (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree(concat('/test/01154_move_partition_long_test_5/{shard}/src_', toString(randConstant())), '{replica}') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:22.362677 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp40072f86-7906-4203-955f-fa6c02d08abb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:22.368489 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.382327 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp822d9f7c-a266-4ecb-8a20-d3b785d7db21' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:22.384989 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.393612 [ 3735 ] {3e056f7f-e3a2-4224-809b-6f0262294a78} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1088559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38538) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE src_14 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree(concat('/test/01154_move_partition_long_test_5/{shard}/src_', toString(randConstant())), '{replica}') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:22.402297 [ 3735 ] {3e056f7f-e3a2-4224-809b-6f0262294a78} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1088559 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:22.414033 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp5b57d2dc-cb7e-4994-b688-5badf420a0ef' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:22.433168 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.522110 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.521935 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.544247 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc2f45c13-01ea-4b21-9fd5-9493f2874e29' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:22.549402 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.702142 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp32456f24-369e-4cac-962c-8b4011596364' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:22.702290 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpb381a37a-6872-42a3-8bce-c56a27f0fc1e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:22.707707 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.708590 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.741430 [ 11850 ] {dc7799e9-fd1e-49e1-8cb9-54c92ebcc243} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01154_move_partition_long.sh) (in query: /* ddl_entry=query-0000000040 */ CREATE TABLE test_5.src_1 UUID '2ae2e940-7c5a-4e0e-98ca-6ac7dd2c2b2b' (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/{shard}/src', concat('{replica}_', toString(randConstant()))) PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:22.769496 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpa988951d-eddd-4269-a975-f0d888bb287c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:22.771966 [ 11850 ] {dc7799e9-fd1e-49e1-8cb9-54c92ebcc243} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38580) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE src_1 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/{shard}/src', concat('{replica}_', toString(randConstant()))) PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:22.774467 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.778278 [ 11850 ] {dc7799e9-fd1e-49e1-8cb9-54c92ebcc243} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:22.787378 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7cd7a083-d330-4997-8145-de7efe1a86bc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:22.790537 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.814692 [ 2186 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp3c341352-3b0d-4ac0-acf1-226d86b475ae' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:22.839828 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.876943 [ 2010 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.877436 [ 1976 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.880026 [ 2053 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.892415 [ 2027 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.907102 [ 2013 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.954337 [ 2076 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:22.979796 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp1f3c9c60-8d95-4dbf-9c6b-ddccabe74582' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:22.985989 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.011775 [ 3737 ] {a5580bb8-f09b-413a-95ae-ab20c2d1348e} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1221995 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column query_id): (while reading from part /var/lib/clickhouse/disks/s3/store/6e4/6e4fe0b1-5b27-4b1d-845a-88e783da8be0/202410_1_49_8/ in table system.query_log (6e4fe0b1-5b27-4b1d-845a-88e783da8be0) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8022): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:56964) (comment: 02765_queries_with_subqueries_profile_events.sh) (in query: SELECT 1 CTE, 1 allow_experimental_analyzer, ProfileEvents['InsertQuery'] InsertQuery, ProfileEvents['SelectQuery'] SelectQuery, ProfileEvents['InsertQueriesWithSubqueries'] InsertQueriesWithSubqueries, ProfileEvents['SelectQueriesWithSubqueries'] SelectQueriesWithSubqueries, ProfileEvents['QueriesWithSubqueries'] QueriesWithSubqueries FROM system.query_log WHERE current_database = currentDatabase() AND type = 'QueryFinish' AND query_id = 'symckpqlaw' FORMAT TSVWithNames;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray, 63ul, 64ul>&, DB::PODArray, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x000000002f2832c7 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27dda3 in /usr/bin/clickhouse 12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? 2024.10.22 00:34:23.017317 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp3f9db372-c432-4f19-b02a-e4ea0806197b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:23.023477 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.029845 [ 3737 ] {a5580bb8-f09b-413a-95ae-ab20c2d1348e} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 1221995 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column query_id): (while reading from part /var/lib/clickhouse/disks/s3/store/6e4/6e4fe0b1-5b27-4b1d-845a-88e783da8be0/202410_1_49_8/ in table system.query_log (6e4fe0b1-5b27-4b1d-845a-88e783da8be0) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8022): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray, 63ul, 64ul>&, DB::PODArray, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x000000002f2832c7 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27dda3 in /usr/bin/clickhouse 12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? 2024.10.22 00:34:23.046845 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp360b99ae-cc0e-4a76-b4b7-11b469b4ca80' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:23.049634 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp86ad2b1d-2a42-4342-9ecd-abc55096442c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:23.050194 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.053486 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.072117 [ 11877 ] {45a81bf4-c91b-49be-9dab-a0a7e773a375} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01154_move_partition_long.sh) (in query: /* ddl_entry=query-0000000041 */ CREATE TABLE test_5.src_5 UUID '7876353f-4b3e-4f76-a730-94daf5db9b62' (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree(concat('/test/01154_move_partition_long_test_5/{shard}/src_', toString(randConstant())), '{replica}') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:23.092601 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb6a09209-1650-435c-98b8-9bccc30fefb5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:23.098827 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.109851 [ 11877 ] {45a81bf4-c91b-49be-9dab-a0a7e773a375} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38492) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE src_5 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree(concat('/test/01154_move_partition_long_test_5/{shard}/src_', toString(randConstant())), '{replica}') PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:23.124115 [ 11877 ] {45a81bf4-c91b-49be-9dab-a0a7e773a375} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:23.199922 [ 11851 ] {965ff1b2-d866-4511-b4d3-2c614ae7d19d} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57094) (comment: 01318_long_unsuccessful_mutation_zookeeper.sh) (in query: SELECT count() FROM system.mutations WHERE table='mutation_table' and database='test_9'), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/Aggregator.cpp:1511: DB::Aggregator::executeOnBlock(DB::Block const&, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdaaa68 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::initGenerate() @ 0x0000000035745847 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744e07 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:23.202711 [ 11851 ] {965ff1b2-d866-4511-b4d3-2c614ae7d19d} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.31 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/Aggregator.cpp:1511: DB::Aggregator::executeOnBlock(DB::Block const&, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdaaa68 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::initGenerate() @ 0x0000000035745847 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744e07 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:23.202950 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.210449 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpa0be4731-f50b-4419-afc6-cb264386e985' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:23.215769 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.233995 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp43c7c2f1-3cea-49e1-8fa4-2e466f0e2a02' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:23.240352 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.242657 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp8d2b4ee1-cb5a-4179-b03a-6a399e99ff3a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:23.259208 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.342423 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp55a020ce-9bbf-4199-a481-3fc39cccb6ce' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:23.344636 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.387213 [ 11850 ] {} TCPHandler: Code: 452. DB::Exception: Setting allow_experimental_analyzer should not be changed. (SETTING_CONSTRAINT_VIOLATION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception>&>(int, FormatStringHelperImpl>&>::type>, std::basic_string_view>&) @ 0x0000000014c9cd36 in /usr/bin/clickhouse 3. ./build_docker/./src/Access/SettingsConstraints.cpp:332: DB::SettingsConstraints::Checker::check(DB::SettingChange&, DB::Field const&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d624f in /usr/bin/clickhouse 4. ./build_docker/./src/Access/SettingsConstraints.cpp:288: DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x000000002e2d45f3 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:32: DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x000000002e2d4fef in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::Context::checkSettingsConstraints(DB::SettingsChanges&, DB::SettingSource) const @ 0x000000002f94f2c3 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:1704: DB::TCPHandler::receiveQuery() @ 0x0000000034f06780 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::receivePacket() @ 0x0000000034eec063 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed58db in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:23.576820 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp4624c5a1-fabd-4b88-b731-f2d73f5f342c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:23.579696 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.623571 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp59dd17ea-e52f-4759-b4e2-0e7d3687d14d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:23.663470 [ 11408 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.693991 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.763959 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp3fdccdbd-51b2-41b4-945a-5b49444ee595' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:23.781891 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.827723 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp467e3ebe-50a1-4850-83b4-1c1a59f17502' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:23.878553 [ 2008 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.880236 [ 2079 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.882377 [ 2093 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.893834 [ 2043 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.909063 [ 2066 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.932360 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.956395 [ 2082 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.957853 [ 2187 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp69cb0b77-26da-4932-8565-c80fe73ebb89' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:23.959285 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp68cd42f5-2f01-4d77-984e-d3103c10f1bc' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:23.963547 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.970994 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:23.976766 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp966bbd10-962e-4321-bc5d-b7ef87b24b12' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:23.986927 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.041838 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp8bd54228-ecff-46fc-8bac-85acce068ec5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.055276 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.056190 [ 2192 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp65c4ecb9-09af-4c0d-aae7-3c24434b0346' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.058996 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.101322 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp87d64c03-c4ec-43bb-8ad0-5c9fe20e1c32' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.112852 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.144195 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp3d1c8ba2-9818-4a07-a546-c4e6e28d2063' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.146764 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.148570 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4592102 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 31. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.153777 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp050fb475-7a0b-49ce-95d9-b17c5dcc484b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.163867 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.217842 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpf72acabb-e98b-47eb-8838-f808ed1122f5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.217904 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmpc007e71d-e711-4c76-8b89-7bbfa9f344f4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.223948 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.231709 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.270025 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp40c9c3f0-ea0b-466f-9b75-0e2f190bb8d6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.272808 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.295262 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp64026077-956b-41dd-b615-07b85f7d5242' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.311749 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.419466 [ 2241 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4516258 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c726b9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.420904 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp94c838d9-26c7-4b2a-98c3-c08a8f1f519b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.435295 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.523815 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp8fe21150-6c61-4242-bacb-0150bcc05216' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.533424 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.560168 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp2c22ffe0-3a73-41e4-83f2-c28b5a936402' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.562795 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.577857 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4432642 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c62f99 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.666641 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpaf22349e-4480-421f-a329-53adbd7063a8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.672493 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.702507 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc0761280-a158-482e-907d-6ef98b570542' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.702633 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpbe8e0edf-dc60-46d1-9c12-3c4bb143a5c2' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.704602 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.704955 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.728557 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpf4255740-0ad6-4138-bd93-e2b82fc3a786' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.729304 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd3e3f2d4-2d11-4d89-9d28-fe7d2e2cfa24' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.730967 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.731306 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.795920 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 4861725 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031ceb946 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d96ae39 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.865399 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp7dd2e7de-d557-4447-9992-baf62c92d76c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.870749 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.871719 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp1ff85b70-fc06-46f1-a332-fb223aeed78e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.874446 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.880665 [ 1976 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.881827 [ 2065 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.887613 [ 1983 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.895358 [ 2047 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.896079 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp482e8596-a1a8-4fb5-81f3-9aea893674f1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.900974 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.912479 [ 2013 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.916190 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpfd458d33-619e-4b4a-8d36-440d977f4b81' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.926589 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.958065 [ 2055 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:24.958320 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp7271a139-c24e-46d2-9b4b-f4aadf397b27' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:24.967393 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.011941 [ 2189 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp4859dd52-18e2-4b66-b725-afe4915cc191' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.021639 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.056323 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp93156bd8-fd9d-4c50-b7dc-5fd4f7e08bf7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.058499 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.073506 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp7436e292-5dcb-4691-be03-3ca0fd137a9d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.078901 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.094169 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp973e0c90-0fe5-4e3d-82b0-e32e91ba9629' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.128807 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpc5aea54c-0856-428f-8c6d-4aa668e774f7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.131239 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.197611 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.217697 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp513e4969-7525-4d5e-87ca-0dfc95f0eab5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.223746 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.228003 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb031ea11-dcf8-424e-8c7a-2fb4a1156b88' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.231899 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.278782 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp3c59542d-e50b-4bb5-84af-10edc52cd379' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.287223 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.291691 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp839d9539-9f6c-4abb-9a49-3a39901e1ec4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.298136 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.329848 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp1b6c20ac-19bc-4688-9ae7-b9c2b0baec61' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.339587 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe357124a-9ed6-4de1-b74e-cdc266bc3b0e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.359815 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.432869 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.457567 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp002e2a60-0ec5-4ac2-8a0a-94438e0261ff' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.468782 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.469231 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpd5259df5-368e-4f82-9ad3-99650c94fa15' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.479357 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.512238 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 5160832 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.517436 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp1217761b-0c9c-454e-9293-7692d652d338' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.519782 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.716079 [ 2188 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp8b34b7db-c216-43b4-a695-006669aaedef' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.719710 [ 2188 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.719805 [ 2189 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp6507050a-c9f1-47af-87bf-bb36c3de9b5c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.722958 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.822167 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpdea4373a-13b0-44aa-8981-39dce77d2712' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.826901 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.882235 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpdd3398c5-da0c-416e-ae5f-f176f8c3f18d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.882598 [ 2072 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.883818 [ 2102 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.893871 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.894297 [ 2099 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.896898 [ 2105 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.914529 [ 2001 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.959931 [ 2074 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.985521 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp995faa96-a4c9-4f0b-9c60-69a8daf56f25' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:25.987082 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 4220522 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:25.995266 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.111614 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpbcf910c1-7f47-446e-bd78-23f03003e43a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:26.115904 [ 2187 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpa3a5beeb-e7c9-4460-b3ed-caa8a4944a3d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:26.124517 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.125863 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.132482 [ 11992 ] {ed09027e-942a-4f90-a218-4c25c9648fb9} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57172) (comment: 01454_storagememory_data_race_challenge.sh) (in query: SELECT count() FROM (SELECT * FROM mem SETTINGS max_threads=2) FORMAT Null;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/Aggregator.cpp:1511: DB::Aggregator::executeOnBlock(DB::Block const&, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdaaa68 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::initGenerate() @ 0x0000000035745847 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744e07 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:26.174760 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp59fddeee-cb4e-4628-b6ad-aa341d38b862' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:26.269574 [ 2758 ] {b733c20a-fa98-4c27-9c47-d8ec4cc186cd} AsynchronousInsertQueue: Failed parsing for query 'INSERT INTO test_7.t_json_async_insert FORMAT JSONAsObject' with query id d48f478f-d304-4375-9fb4-82b19a18e2bf. DB::Exception: Cannot parse object: (at row 1) 2024.10.22 00:34:26.494455 [ 11992 ] {ed09027e-942a-4f90-a218-4c25c9648fb9} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/Aggregator.cpp:1511: DB::Aggregator::executeOnBlock(DB::Block const&, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdaaa68 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::initGenerate() @ 0x0000000035745847 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744e07 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:26.494671 [ 11405 ] {e4ab47a8-bc7e-4ccf-acd9-b06269801dee} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57194) (comment: 01318_long_unsuccessful_mutation_zookeeper.sh) (in query: SELECT count() FROM system.mutations WHERE table='mutation_table' and database='test_9'), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/Aggregator.cpp:1511: DB::Aggregator::executeOnBlock(DB::Block const&, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdaaa68 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::initGenerate() @ 0x0000000035745847 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744e07 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:26.494528 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 5226949 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c53899 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c51386 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d961c79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.494665 [ 3877 ] {d65ef796-5886-4c5f-9c69-fdc36e98228e} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01154_move_partition_long.sh) (in query: /* ddl_entry=query-0000000042 */ CREATE TABLE test_5.src_13 UUID '6f0e6a28-ac65-401f-a005-46dd9f1f60ea' (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/{shard}/src', concat('{replica}_', toString(randConstant()))) PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 31. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 2024.10.22 00:34:26.494770 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.494902 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.495185 [ 12113 ] {d48f478f-d304-4375-9fb4-82b19a18e2bf} executeQuery: Code: 117. DB::Exception: Cannot parse object: (at row 1) : While executing WaitForAsyncInsert. (INCORRECT_DATA) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38710) (comment: 02421_type_json_async_insert.sh) (in query: INSERT INTO t_json_async_insert FORMAT JSONAsObject ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/DataTypes/Serializations/SerializationObject.cpp:58: void DB::SerializationObject>::deserializeTextImpl>::deserializeTextJSON(DB::IColumn&, DB::ReadBuffer&, DB::FormatSettings const&) const::'lambda'(String&)>(DB::IColumn&, DB::SerializationObject>::deserializeTextJSON(DB::IColumn&, DB::ReadBuffer&, DB::FormatSettings const&) const::'lambda'(String&)&&) const @ 0x000000002f25b5ac in /usr/bin/clickhouse 4. ./build_docker/./src/DataTypes/Serializations/SerializationObject.cpp:122: DB::SerializationObject>::deserializeTextJSON(DB::IColumn&, DB::ReadBuffer&, DB::FormatSettings const&) const @ 0x000000002f24b49e in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Formats/Impl/JSONAsStringRowInputFormat.cpp:0: DB::JSONAsRowInputFormat::readRow(std::vector::mutable_ptr, std::allocator::mutable_ptr>>&, DB::RowReadExtension&) @ 0x000000003533b14e in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x0000000035167db7 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/StreamingFormatExecutor.cpp:60: DB::StreamingFormatExecutor::execute() @ 0x0000000035035229 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/StreamingFormatExecutor.cpp:45: DB::StreamingFormatExecutor::execute(DB::ReadBuffer&) @ 0x0000000035034b1e in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.cpp:0: DB::AsynchronousInsertQueue::processData(DB::AsynchronousInsertQueue::InsertQuery, std::unique_ptr>, std::shared_ptr) @ 0x000000002f8a9ea8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.h:50: void std::__function::__policy_invoker::__call_impl>, std::shared_ptr)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000002f8b1cf5 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:26.501184 [ 11405 ] {e4ab47a8-bc7e-4ccf-acd9-b06269801dee} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/Aggregator.cpp:1511: DB::Aggregator::executeOnBlock(DB::Block const&, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdaaa68 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::initGenerate() @ 0x0000000035745847 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744e07 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:26.503213 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.535677 [ 14378 ] {227148c9-c6dc-4fc7-a179-f9bd8302be61} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1128576 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing Numbers. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57182) (comment: 01454_storagememory_data_race_challenge.sh) (in query: INSERT INTO mem SELECT number FROM numbers(1000000);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d632bcc in /usr/bin/clickhouse 10. ./build_docker/./src/Columns/ColumnVector.h:0: DB::(anonymous namespace)::NumbersSource::generate() @ 0x000000002d237355 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:26.616368 [ 2197 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp24f84f2c-ad90-4c3c-a159-5458af0be7b8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:26.625409 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpa4ccfc41-ce38-4093-a7bd-981185e0109c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:26.625536 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp54832960-cfb6-4425-8a71-2d3500658d86' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:26.674648 [ 3877 ] {d65ef796-5886-4c5f-9c69-fdc36e98228e} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38548) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE src_13 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/{shard}/src', concat('{replica}_', toString(randConstant()))) PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 31. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 2024.10.22 00:34:26.674783 [ 14378 ] {227148c9-c6dc-4fc7-a179-f9bd8302be61} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1128576 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing Numbers. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d632bcc in /usr/bin/clickhouse 10. ./build_docker/./src/Columns/ColumnVector.h:0: DB::(anonymous namespace)::NumbersSource::generate() @ 0x000000002d237355 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:26.674624 [ 2758 ] {b733c20a-fa98-4c27-9c47-d8ec4cc186cd} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1069631 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 02421_type_json_async_insert.sh) (in query: INSERT INTO test_7.t_json_async_insert FORMAT JSONAsObject), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 2024.10.22 00:34:26.675066 [ 12113 ] {d48f478f-d304-4375-9fb4-82b19a18e2bf} TCPHandler: Code: 117. DB::Exception: Cannot parse object: (at row 1) : While executing WaitForAsyncInsert. (INCORRECT_DATA), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, char const (&) [20]) @ 0x000000000cd02649 in /usr/bin/clickhouse 3. ./build_docker/./src/DataTypes/Serializations/SerializationObject.cpp:58: void DB::SerializationObject>::deserializeTextImpl>::deserializeTextJSON(DB::IColumn&, DB::ReadBuffer&, DB::FormatSettings const&) const::'lambda'(String&)>(DB::IColumn&, DB::SerializationObject>::deserializeTextJSON(DB::IColumn&, DB::ReadBuffer&, DB::FormatSettings const&) const::'lambda'(String&)&&) const @ 0x000000002f25b5ac in /usr/bin/clickhouse 4. ./build_docker/./src/DataTypes/Serializations/SerializationObject.cpp:122: DB::SerializationObject>::deserializeTextJSON(DB::IColumn&, DB::ReadBuffer&, DB::FormatSettings const&) const @ 0x000000002f24b49e in /usr/bin/clickhouse 5. ./build_docker/./src/Processors/Formats/Impl/JSONAsStringRowInputFormat.cpp:0: DB::JSONAsRowInputFormat::readRow(std::vector::mutable_ptr, std::allocator::mutable_ptr>>&, DB::RowReadExtension&) @ 0x000000003533b14e in /usr/bin/clickhouse 6. ./build_docker/./src/Processors/Formats/IRowInputFormat.cpp:0: DB::IRowInputFormat::generate() @ 0x0000000035167db7 in /usr/bin/clickhouse 7. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 9. ./build_docker/./src/Processors/Executors/StreamingFormatExecutor.cpp:60: DB::StreamingFormatExecutor::execute() @ 0x0000000035035229 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Executors/StreamingFormatExecutor.cpp:45: DB::StreamingFormatExecutor::execute(DB::ReadBuffer&) @ 0x0000000035034b1e in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.cpp:0: DB::AsynchronousInsertQueue::processData(DB::AsynchronousInsertQueue::InsertQuery, std::unique_ptr>, std::shared_ptr) @ 0x000000002f8a9ea8 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/AsynchronousInsertQueue.h:50: void std::__function::__policy_invoker::__call_impl>, std::shared_ptr)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000002f8b1cf5 in /usr/bin/clickhouse 13. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 14. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 17. ? @ 0x00007f11b339dac3 in ? 18. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:26.675258 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 5149239 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031cccb46 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d9693f9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.676417 [ 11891 ] {a2a290af-ff6a-46b0-9d4a-2ab72da803c2} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1049525 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/igw/zggzgopcyaemprwqycwocqlldcrtz, hash key: 2d0275b51e53c035cc6d8a12614313af, file_offset_of_buffer_end: 0, read_until_position: 183, internal buffer end: 183, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: a2a290af-ff6a-46b0-9d4a-2ab72da803c2:2385, file segment info: File segment: [0, 182], key: 2d0275b51e53c035cc6d8a12614313af, state: DOWNLOADING, downloaded size: 0, reserved size: 183, downloader id: a2a290af-ff6a-46b0-9d4a-2ab72da803c2:2385, current write offset: 0, caller id: a2a290af-ff6a-46b0-9d4a-2ab72da803c2:2385, kind: Regular, unbound: 0: (while reading column ParsedParams.Key1): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/84f/84f788e2-4f4e-45fa-bf6b-97219cb78fa2/201403_1_1_0/ in table test.visits (84f788e2-4f4e-45fa-bf6b-97219cb78fa2) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 26728): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57062) (comment: 00013_sorting_of_nested.sql) (in query: SELECT ParsedParams.Key1 FROM test.visits FINAL WHERE VisitID != 0 AND notEmpty(ParsedParams.Key1) ORDER BY VisitID LIMIT 10 ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 5. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 17. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec784a9 in /usr/bin/clickhouse 18. ./build_docker/./src/IO/ReadBuffer.h:72: DB::MergeTreeMarksLoader::loadMarksImpl() @ 0x00000000343aece8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::MergeTreeMarksLoader::loadMarks() @ 0x00000000343ac8a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/threadPoolCallbackRunner.h:43: std::__packaged_task_func> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'(), std::allocator> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'()>, std::shared_ptr ()>::operator()() @ 0x00000000343b2cba in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task ()>::operator()() @ 0x00000000343b7f6c in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:26.676471 [ 11408 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.684594 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.685419 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.691307 [ 3877 ] {d65ef796-5886-4c5f-9c69-fdc36e98228e} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 31. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 2024.10.22 00:34:26.696582 [ 2758 ] {} AsynchronousInsertQueue: Failed insertion for query 'INSERT INTO test_7.t_json_async_insert FORMAT JSONAsObject': Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1069631 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.721078 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.781062 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.812218 [ 3746 ] {a4f9012e-8820-459a-9b0f-664d6991b838} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1069631 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing WaitForAsyncInsert. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38696) (comment: 02421_type_json_async_insert.sh) (in query: INSERT INTO t_json_async_insert FORMAT JSONAsObject ), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 2024.10.22 00:34:26.814443 [ 3746 ] {a4f9012e-8820-459a-9b0f-664d6991b838} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1069631 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing WaitForAsyncInsert. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 24. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 2024.10.22 00:34:26.834654 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc30bec61-9fbd-440a-af3f-29a01d43d4b7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:26.837859 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp204d3624-7a06-4c92-904c-9895e58a2247' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:26.840305 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.861152 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.888324 [ 1985 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.892831 [ 11891 ] {a2a290af-ff6a-46b0-9d4a-2ab72da803c2} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.32 GiB (attempt to allocate chunk of 1049525 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: Cache info: Buffer path: common/igw/zggzgopcyaemprwqycwocqlldcrtz, hash key: 2d0275b51e53c035cc6d8a12614313af, file_offset_of_buffer_end: 0, read_until_position: 183, internal buffer end: 183, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: a2a290af-ff6a-46b0-9d4a-2ab72da803c2:2385, file segment info: File segment: [0, 182], key: 2d0275b51e53c035cc6d8a12614313af, state: DOWNLOADING, downloaded size: 0, reserved size: 183, downloader id: a2a290af-ff6a-46b0-9d4a-2ab72da803c2:2385, current write offset: 0, caller id: a2a290af-ff6a-46b0-9d4a-2ab72da803c2:2385, kind: Regular, unbound: 0: (while reading column ParsedParams.Key1): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/84f/84f788e2-4f4e-45fa-bf6b-97219cb78fa2/201403_1_1_0/ in table test.visits (84f788e2-4f4e-45fa-bf6b-97219cb78fa2) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 26728): While executing MergeTreeInOrder. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 5. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x00000000321c462b in /usr/bin/clickhouse 11. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:0: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000002dd44154 in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:964: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x000000002dd492e1 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:774: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000002dd45c4f in /usr/bin/clickhouse 14. ./build_docker/./src/IO/ReadBuffer.h:0: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000002dd284d4 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:179: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000002dd26eeb in /usr/bin/clickhouse 16. ./build_docker/./src/IO/ReadBuffer.h:72: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x000000002ec717d2 in /usr/bin/clickhouse 17. ./build_docker/./src/Compression/CompressedReadBufferFromFile.cpp:22: DB::CompressedReadBufferFromFile::nextImpl() @ 0x000000002ec784a9 in /usr/bin/clickhouse 18. ./build_docker/./src/IO/ReadBuffer.h:72: DB::MergeTreeMarksLoader::loadMarksImpl() @ 0x00000000343aece8 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:37: DB::MergeTreeMarksLoader::loadMarks() @ 0x00000000343ac8a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/threadPoolCallbackRunner.h:43: std::__packaged_task_func> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'(), std::allocator> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunner, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::'lambda'()>, std::shared_ptr ()>::operator()() @ 0x00000000343b2cba in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/future:0: std::packaged_task ()>::operator()() @ 0x00000000343b7f6c in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:26.896294 [ 2010 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.901248 [ 2011 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.898847 [ 2094 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.916521 [ 2047 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:26.962051 [ 2053 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:27.058619 [ 11870 ] {4832da62-b275-4060-9f1d-ad7995bf9142} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01154_move_partition_long.sh) (in query: /* ddl_entry=query-0000000043 */ CREATE TABLE test_5.src_4 UUID 'b0c6d758-5e20-4dca-bb01-fa8c13a79215' (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/{shard}/src', concat('{replica}_', toString(randConstant()))) PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = 0, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:27.076108 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp6b2ed0a5-39a0-4c6f-b255-ef788c150225' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:27.082345 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:27.084463 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp5cedd67b-fc2c-406b-a2cb-4b2fc26e2ce7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:27.089290 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:27.089897 [ 2307 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 5180969 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ca0bd9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:27.091764 [ 11870 ] {4832da62-b275-4060-9f1d-ad7995bf9142} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38468) (comment: 01154_move_partition_long.sh) (in query: CREATE TABLE src_4 (`p` UInt64, `k` UInt64, `v` UInt64) ENGINE = ReplicatedMergeTree('/test/01154_move_partition_long_test_5/{shard}/src', concat('{replica}_', toString(randConstant()))) PARTITION BY p % 10 ORDER BY k SETTINGS index_granularity = 12805, min_bytes_for_wide_part = 203795847, ratio_of_defaults_for_sparse_serialization = 0., merge_max_block_size = 6155, prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 8790557277, index_granularity_bytes = 14355850, allow_vertical_merges_from_compact_to_wide_parts = false, marks_compress_block_size = 64846, primary_key_compress_block_size = 13090), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:27.097863 [ 11870 ] {4832da62-b275-4060-9f1d-ad7995bf9142} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.30 GiB (attempt to allocate chunk of 1087551 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x0000000033ef3126 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool) @ 0x000000003311a5e9 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool const&, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, bool const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool const&, DB::RenamingRestrictions&, bool&) @ 0x00000000348f8df4 in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: DB::create(DB::StorageFactory::Arguments const&) @ 0x00000000348ed765 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, bool) const @ 0x0000000032e53d96 in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1446: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x0000000030f66981 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f53002 in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x0000000030f750b3 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 29. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 30. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1256: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x0000000030f52d61 in /usr/bin/clickhouse 2024.10.22 00:34:27.156927 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7ac9dc46-4e3b-4869-bfd5-5f1edc6ad295' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:27.167036 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:27.168382 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp17bfcce8-0bcd-4d08-b94c-7dc7ab2568d2' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:27.172113 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:27.197281 [ 11405 ] {67ab9f4c-ac08-4bc3-8d5e-afbf7817f2d6} executeQuery: Code: 47. DB::Exception: Missing columns: 'data.k1' while processing query: 'SELECT data.k1 FROM t_json_async_insert ORDER BY data.k1 ASC', required columns: 'data.k1'. (UNKNOWN_IDENTIFIER) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57258) (comment: 02421_type_json_async_insert.sh) (in query: SELECT data.k1 FROM t_json_async_insert ORDER BY data.k1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000bdd57ee in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr const&, bool, bool) @ 0x0000000031ed2df8 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edcb59 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:27.232658 [ 11405 ] {67ab9f4c-ac08-4bc3-8d5e-afbf7817f2d6} TCPHandler: Code: 47. DB::Exception: Missing columns: 'data.k1' while processing query: 'SELECT data.k1 FROM t_json_async_insert ORDER BY data.k1 ASC', required columns: 'data.k1'. (UNKNOWN_IDENTIFIER), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000bdd57ee in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/TreeRewriter.cpp:1138: DB::TreeRewriterResult::collectUsedColumns(std::shared_ptr const&, bool, bool) @ 0x0000000031ed2df8 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/TreeRewriter.cpp:0: DB::TreeRewriter::analyzeSelect(std::shared_ptr&, DB::TreeRewriterResult&&, DB::SelectQueryOptions const&, std::vector> const&, std::vector> const&, std::shared_ptr) const @ 0x0000000031edcb59 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:608: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x0000000031516aa0 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 14. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 18. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:27.324589 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpc145600d-5b78-4cbc-b00b-73afdb5e3abb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:27.468053 [ 14378 ] {8ecc8549-52c7-4526-8090-07682fa705d7} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1128576 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing Numbers. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57252) (comment: 01454_storagememory_data_race_challenge.sh) (in query: INSERT INTO mem SELECT number FROM numbers(1000000);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d632bcc in /usr/bin/clickhouse 10. ./build_docker/./src/Columns/ColumnVector.h:0: DB::(anonymous namespace)::NumbersSource::generate() @ 0x000000002d237355 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:27.468359 [ 2244 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousInsertLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.36 GiB (attempt to allocate chunk of 5170473 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031d1c359 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:27.514809 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:27.523284 [ 14378 ] {8ecc8549-52c7-4526-8090-07682fa705d7} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1128576 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing Numbers. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d632bcc in /usr/bin/clickhouse 10. ./build_docker/./src/Columns/ColumnVector.h:0: DB::(anonymous namespace)::NumbersSource::generate() @ 0x000000002d237355 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:27.537539 [ 2199 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp35e26b5a-9589-41b3-8cc9-fde070feb1d6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:27.571757 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:27.573028 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp02089563-5610-4a8f-a5a6-968abd38ec71' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:27.587750 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.34 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:27.774871 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp1378f21f-8673-470a-8d12-647892e148b2' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:27.892152 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:27.892417 [ 2101 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:27.898680 [ 2031 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:27.903805 [ 2021 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:27.905800 [ 2051 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:27.919045 [ 2107 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:27.993273 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp658e6c8c-9d0d-4080-a8c9-69af247855d9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:28.006473 [ 11405 ] {60285672-21db-4ee0-9dca-25cad4ae8ea2} executeQuery: Code: 60. DB::Exception: Table test_5.src_8 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57294) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE src_8 MOVE PARTITION 9 TO TABLE dst_8), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.006564 [ 1997 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:28.143071 [ 11850 ] {fbf5550b-4c1a-4d1d-afc1-44981dcdd04a} executeQuery: Code: 60. DB::Exception: Table test_5.src_3 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57286) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO src_3 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 88), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.143638 [ 11992 ] {0efc07a8-085f-4765-b252-d43a62379deb} executeQuery: Code: 60. DB::Exception: Table test_5.src_1 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57272) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE src_1 REPLACE PARTITION 4 FROM src_10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.143761 [ 2495 ] {724d7fdd-13bb-4fec-98cc-f42c1d375651} executeQuery: Code: 60. DB::Exception: Table test_5.src_7 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57310) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO src_7 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 73), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.230133 [ 2187 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp37f23c8f-dedf-4f3a-aa7a-f9902d59d9a4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:28.278872 [ 2487 ] {239bec79-294f-48b4-aa75-2cd74ff6f16a} executeQuery: Code: 60. DB::Exception: Table test_5.src_15 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57320) (comment: 01154_move_partition_long.sh) (in query: OPTIMIZE TABLE src_15), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterOptimizeQuery.cpp:0: DB::InterpreterOptimizeQuery::execute() @ 0x00000000314d9cab in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.279011 [ 1912 ] {af89d9e6-5507-406f-b777-39ac6ac39a9a} executeQuery: Code: 60. DB::Exception: Table test_5.dst_11 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57336) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO dst_11 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 60), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.289312 [ 11405 ] {60285672-21db-4ee0-9dca-25cad4ae8ea2} TCPHandler: Code: 60. DB::Exception: Table test_5.src_8 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.289241 [ 11424 ] {1d2d0534-e562-4756-b725-74b380aab244} executeQuery: Code: 60. DB::Exception: Could not find table: dst_10. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57356) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE dst_10 DROP PARTITION 1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.289666 [ 11992 ] {0efc07a8-085f-4765-b252-d43a62379deb} TCPHandler: Code: 60. DB::Exception: Table test_5.src_1 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.289736 [ 11850 ] {fbf5550b-4c1a-4d1d-afc1-44981dcdd04a} TCPHandler: Code: 60. DB::Exception: Table test_5.src_3 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.290047 [ 1912 ] {af89d9e6-5507-406f-b777-39ac6ac39a9a} TCPHandler: Code: 60. DB::Exception: Table test_5.dst_11 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.290176 [ 2495 ] {724d7fdd-13bb-4fec-98cc-f42c1d375651} TCPHandler: Code: 60. DB::Exception: Table test_5.src_7 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.290653 [ 2487 ] {239bec79-294f-48b4-aa75-2cd74ff6f16a} TCPHandler: Code: 60. DB::Exception: Table test_5.src_15 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterOptimizeQuery.cpp:0: DB::InterpreterOptimizeQuery::execute() @ 0x00000000314d9cab in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.295409 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:28.301763 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3aa01b9e-7b8e-4c3d-ad35-344ac92b5f4f::202410_95_100_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1102815 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:28.303008 [ 11424 ] {1d2d0534-e562-4756-b725-74b380aab244} TCPHandler: Code: 60. DB::Exception: Could not find table: dst_10. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.314016 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6e4fe0b1-5b27-4b1d-845a-88e783da8be0::202410_50_57_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1256095 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:28.328562 [ 12062 ] {5e07c5ce-89df-4ed1-a8ba-c0b71fb82da2} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57392) (comment: 01454_storagememory_data_race_challenge.sh) (in query: SELECT count() FROM (SELECT * FROM mem SETTINGS max_threads=2) FORMAT Null;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/Aggregator.cpp:1511: DB::Aggregator::executeOnBlock(DB::Block const&, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdaaa68 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::initGenerate() @ 0x0000000035745847 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744e07 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.392941 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:28.424859 [ 12062 ] {5e07c5ce-89df-4ed1-a8ba-c0b71fb82da2} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.35 GiB (attempt to allocate chunk of 0 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit has freed not enough memory.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000002fd8037a in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/Aggregator.cpp:0: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdac0b3 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/Aggregator.cpp:1511: DB::Aggregator::executeOnBlock(DB::Block const&, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000002fdaaa68 in /usr/bin/clickhouse 10. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::initGenerate() @ 0x0000000035745847 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Transforms/AggregatingTransform.cpp:0: DB::AggregatingTransform::work() @ 0x0000000035744e07 in /usr/bin/clickhouse 12. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 15. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 16. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 17. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 19. ? @ 0x00007f11b339dac3 in ? 20. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.524783 [ 11837 ] {e09a33b0-ea67-46d7-826e-acb93a64ae6a} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1128576 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing Numbers. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57404) (comment: 01454_storagememory_data_race_challenge.sh) (in query: INSERT INTO mem SELECT number FROM numbers(1000000);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d632bcc in /usr/bin/clickhouse 10. ./build_docker/./src/Columns/ColumnVector.h:0: DB::(anonymous namespace)::NumbersSource::generate() @ 0x000000002d237355 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.531414 [ 11837 ] {e09a33b0-ea67-46d7-826e-acb93a64ae6a} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1128576 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing Numbers. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d632bcc in /usr/bin/clickhouse 10. ./build_docker/./src/Columns/ColumnVector.h:0: DB::(anonymous namespace)::NumbersSource::generate() @ 0x000000002d237355 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.565026 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp7fa8ab86-eb71-4b18-a193-f00587b33359' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:28.565237 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpea41d791-eefe-4d2e-9a41-f6df19559e4b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:28.569933 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:28.570002 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:28.793341 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp39085963-9439-4128-94fe-6453552c1494' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:28.793710 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpb3192c55-de11-43b4-9be1-b20dd9289745' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:28.803525 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:28.805687 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.33 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:28.828208 [ 11861 ] {2e459b81-4e48-475e-8a7f-7f5adf11c637} executeQuery: Code: 60. DB::Exception: Could not find table: dst_8. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57428) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE dst_8 DROP PART ''), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.839444 [ 11861 ] {2e459b81-4e48-475e-8a7f-7f5adf11c637} TCPHandler: Code: 60. DB::Exception: Could not find table: dst_8. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:28.894141 [ 2022 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:28.900997 [ 2087 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:28.905708 [ 1989 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:28.907273 [ 1980 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:28.921357 [ 2041 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.010339 [ 2017 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.016952 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpae44a55d-086b-4508-aff3-0e3ccae2954a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:29.017237 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp7777d9e6-eb0b-4eda-8c4c-28cc75607a84' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:29.020885 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.025149 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.030457 [ 11886 ] {8da398e6-046d-4afc-a1a2-4231ad3b5f56} executeQuery: Code: 60. DB::Exception: Table test_5.dst_5 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57446) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO dst_5 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 16), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.044983 [ 11886 ] {8da398e6-046d-4afc-a1a2-4231ad3b5f56} TCPHandler: Code: 60. DB::Exception: Table test_5.dst_5 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.072907 [ 2191 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp67aa0a54-f784-4cf3-9325-004ca3990045' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:29.074641 [ 11325 ] {c2729e5f-708f-495b-9722-e309c4d7f456} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1221995 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column query_id): (while reading from part /var/lib/clickhouse/disks/s3/store/6e4/6e4fe0b1-5b27-4b1d-845a-88e783da8be0/202410_1_49_8/ in table system.query_log (6e4fe0b1-5b27-4b1d-845a-88e783da8be0) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8022): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57154) (comment: 02765_queries_with_subqueries_profile_events.sh) (in query: SELECT 1 CTE_Multi, 1 allow_experimental_analyzer, ProfileEvents['InsertQuery'] InsertQuery, ProfileEvents['SelectQuery'] SelectQuery, ProfileEvents['InsertQueriesWithSubqueries'] InsertQueriesWithSubqueries, ProfileEvents['SelectQueriesWithSubqueries'] SelectQueriesWithSubqueries, ProfileEvents['QueriesWithSubqueries'] QueriesWithSubqueries FROM system.query_log WHERE current_database = currentDatabase() AND type = 'QueryFinish' AND query_id = 'kzrfyiyhrx' FORMAT TSVWithNames;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray, 63ul, 64ul>&, DB::PODArray, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x000000002f2832c7 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27dda3 in /usr/bin/clickhouse 12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? 2024.10.22 00:34:29.076855 [ 11867 ] {274079dd-977b-4afb-aca1-5abd43ae735d} executeQuery: Code: 60. DB::Exception: Table test_5.src_2 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57464) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE src_2 REPLACE PARTITION 4 FROM src_13), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.081411 [ 11867 ] {274079dd-977b-4afb-aca1-5abd43ae735d} TCPHandler: Code: 60. DB::Exception: Table test_5.src_2 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.087769 [ 2191 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.093208 [ 11325 ] {c2729e5f-708f-495b-9722-e309c4d7f456} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1221995 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: (while reading column query_id): (while reading from part /var/lib/clickhouse/disks/s3/store/6e4/6e4fe0b1-5b27-4b1d-845a-88e783da8be0/202410_1_49_8/ in table system.query_log (6e4fe0b1-5b27-4b1d-845a-88e783da8be0) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8022): While executing MergeTreeThread. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:0: Allocator::realloc(void*, unsigned long, unsigned long, unsigned long) @ 0x000000001d532347 in /usr/bin/clickhouse 9. void DB::PODArrayBase<1ul, 4096ul, Allocator, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000bdc5ce9 in /usr/bin/clickhouse 10. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:176: void DB::deserializeBinarySSE2<1>(DB::PODArray, 63ul, 64ul>&, DB::PODArray, 63ul, 64ul>&, DB::ReadBuffer&, unsigned long) @ 0x000000002f2832c7 in /usr/bin/clickhouse 11. ./build_docker/./src/DataTypes/Serializations/SerializationString.cpp:0: DB::SerializationString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000002f27dda3 in /usr/bin/clickhouse 12. ./build_docker/./src/DataTypes/Serializations/ISerialization.cpp:0: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW::immutable_ptr&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr&, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>*) const @ 0x000000002f141e9e in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:196: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr const&, COW::immutable_ptr&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&, bool) @ 0x0000000034445eca in /usr/bin/clickhouse 14. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderWide.cpp:159: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x00000000344447ec in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:107: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector::immutable_ptr, std::allocator::immutable_ptr>>&) @ 0x000000003448b46b in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.h:136: DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult const&, unsigned long&) @ 0x00000000344a8124 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:979: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3b0d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeRangeReader.cpp:0: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x00000000344a3a9a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:398: DB::IMergeTreeSelectAlgorithm::readFromPartImpl() @ 0x000000003447f779 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:441: DB::IMergeTreeSelectAlgorithm::readFromPart() @ 0x0000000034480fa4 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp:0: DB::IMergeTreeSelectAlgorithm::read() @ 0x0000000034479640 in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeSource.cpp:181: DB::MergeTreeSource::tryGenerate() @ 0x0000000035d328d8 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 24. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:359: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000035001cc2 in /usr/bin/clickhouse 27. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 28. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 29. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 31. ? @ 0x00007f11b339dac3 in ? 2024.10.22 00:34:29.105584 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp56448a7f-e8cc-4057-aeae-55af51267d9b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:29.123201 [ 2694 ] {d8ac4c74-6240-4126-a514-d7f590dffaee} executeQuery: Code: 60. DB::Exception: Table test_5.src_14 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57482) (comment: 01154_move_partition_long.sh) (in query: OPTIMIZE TABLE src_14), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterOptimizeQuery.cpp:0: DB::InterpreterOptimizeQuery::execute() @ 0x00000000314d9cab in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.126409 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.137315 [ 2694 ] {d8ac4c74-6240-4126-a514-d7f590dffaee} TCPHandler: Code: 60. DB::Exception: Table test_5.src_14 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterOptimizeQuery.cpp:0: DB::InterpreterOptimizeQuery::execute() @ 0x00000000314d9cab in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.137573 [ 11864 ] {a7b1c690-28ed-488e-8f50-ae59f4ae322b} executeQuery: Code: 60. DB::Exception: Table test_5.src_14 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57452) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO src_14 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 19), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.151771 [ 11864 ] {a7b1c690-28ed-488e-8f50-ae59f4ae322b} TCPHandler: Code: 60. DB::Exception: Table test_5.src_14 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.163054 [ 12137 ] {a6b7262d-263c-4668-bdae-69fa2117f23f} executeQuery: Code: 60. DB::Exception: Could not find table: dst_2. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57484) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE dst_2 DROP PARTITION 7), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.173704 [ 12137 ] {a6b7262d-263c-4668-bdae-69fa2117f23f} TCPHandler: Code: 60. DB::Exception: Could not find table: dst_2. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.198372 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 4641506 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.261713 [ 2184 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpa6e0e79b-5904-4659-8a24-a4ac0a00bb81' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:29.284811 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.404149 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpa3e1274e-cb0b-49ca-a7fe-90dbc8c91419' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:29.412968 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.416354 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp5c834680-c38d-404f-8870-ce053181a057' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:29.427442 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.560161 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp721de278-0d7f-4962-bb60-e5dd9eb29ead' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:29.561644 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmpfd0cd56a-8159-4e8b-8657-352d3a0116e7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:29.566122 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.568656 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.611159 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp5c0b795a-ee8a-4b01-b0fd-29ce21eb5aa4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:29.640053 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.656766 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpcccf8ea4-3b4b-4203-9016-3ff261f2a555' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:29.656803 [ 11864 ] {80f08c18-fce5-43a3-898d-88e5089b8095} executeQuery: Code: 60. DB::Exception: Table test_5.dst_4 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37632) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO dst_4 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 16), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.682429 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.693125 [ 11864 ] {80f08c18-fce5-43a3-898d-88e5089b8095} TCPHandler: Code: 60. DB::Exception: Table test_5.dst_4 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.726830 [ 2189 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpd8acff6b-b86b-476c-a68f-95b302adc37a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:29.727019 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp2c996520-0bd9-4293-a036-5cc3c7834620' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:29.738284 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.740435 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.752243 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp04d6e73d-2444-4634-a877-3b94d61b2473' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:29.757446 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.778858 [ 11861 ] {f5c2c4ee-af90-4f8e-b542-09df464b6834} executeQuery: Code: 60. DB::Exception: Table test_5.src_8 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37638) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO src_8 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 21), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.798507 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp04b68c9c-f6cd-4693-80b3-c7a2308c14a7' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:29.837806 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp995318d5-2c8c-4194-9989-c531e177ceb3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:29.947861 [ 11861 ] {f5c2c4ee-af90-4f8e-b542-09df464b6834} TCPHandler: Code: 60. DB::Exception: Table test_5.src_8 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.948423 [ 2055 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.948505 [ 2036 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.948967 [ 2060 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.949080 [ 2694 ] {8f652566-c4e5-4d01-bfa0-8c899e676fe2} executeQuery: Code: 60. DB::Exception: Table test_5.dst_1 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01154_move_partition_long.sh) (in query: /* ddl_entry=query-0000000044 */ ALTER TABLE test_5.src_0 MOVE PARTITION 9 TO TABLE dst_1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:5171: DB::MergeTreeData::alterPartition(std::shared_ptr const&, std::vector> const&, std::shared_ptr) @ 0x0000000033fd5ab2 in /usr/bin/clickhouse 7. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c16c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000311292be in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.949156 [ 2098 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.949529 [ 11886 ] {2caf4f39-2767-4ab3-8766-45b311f21173} executeQuery: Code: 60. DB::Exception: Could not find table: dst_3. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37646) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE dst_3 DROP PARTITION 3), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.949214 [ 2088 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.962083 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.962938 [ 11886 ] {2caf4f39-2767-4ab3-8766-45b311f21173} TCPHandler: Code: 60. DB::Exception: Could not find table: dst_3. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.964699 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:29.992267 [ 2694 ] {8f652566-c4e5-4d01-bfa0-8c899e676fe2} executeQuery: Code: 60. DB::Exception: Table test_5.dst_1 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37616) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE src_0 MOVE PARTITION 9 TO TABLE dst_1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:5171: DB::MergeTreeData::alterPartition(std::shared_ptr const&, std::vector> const&, std::shared_ptr) @ 0x0000000033fd5ab2 in /usr/bin/clickhouse 7. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c16c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000311292be in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:29.995879 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpaed275e2-84c7-4341-83a9-9986828a917b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:30.003561 [ 2694 ] {8f652566-c4e5-4d01-bfa0-8c899e676fe2} TCPHandler: Code: 60. DB::Exception: Table test_5.dst_1 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:5171: DB::MergeTreeData::alterPartition(std::shared_ptr const&, std::vector> const&, std::shared_ptr) @ 0x0000000033fd5ab2 in /usr/bin/clickhouse 7. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c16c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000311292be in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:30.005664 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.006362 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp4d1c1295-e2fc-44b3-8348-b14cec2d9bc1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:30.012617 [ 1986 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.036731 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.074717 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpa583c5cb-d7e4-4973-b635-d045fd33007a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:30.106295 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.181722 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp24e2e970-8a16-4f94-bd23-a2fb612fe7cb' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:30.186918 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.326476 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp8acb8b25-6eea-4dc0-a9b3-adc230b55c71' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:30.344700 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.346260 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpe2188471-4b34-4cde-b82a-69cd55dcab10' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:30.350077 [ 11861 ] {59dcc4a1-e2d6-4ac3-97eb-eb8e07b30a40} executeQuery: Code: 60. DB::Exception: Table test_5.dst_3 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37668) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO dst_3 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 26), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:30.360712 [ 11861 ] {59dcc4a1-e2d6-4ac3-97eb-eb8e07b30a40} TCPHandler: Code: 60. DB::Exception: Table test_5.dst_3 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:30.370890 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.389467 [ 11886 ] {ddfab4a1-82a9-49c0-8fed-4fdef942665e} executeQuery: Code: 60. DB::Exception: Table test_5.src_13 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37680) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE src_13 REPLACE PARTITION 3 FROM src_8), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:30.404978 [ 11886 ] {ddfab4a1-82a9-49c0-8fed-4fdef942665e} TCPHandler: Code: 60. DB::Exception: Table test_5.src_13 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:30.428203 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp3d4f47b4-602d-4588-be7a-0cdb5d941358' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:30.433653 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.435420 [ 2192 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp3bce4dd2-2cbf-4c09-94c3-50e1a693f890' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:30.444245 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.495967 [ 12137 ] {4638ebbc-63a7-4bbd-ad16-e081339a3f8b} executeQuery: Code: 60. DB::Exception: Table test_5.dst_15 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37706) (comment: 01154_move_partition_long.sh) (in query: OPTIMIZE TABLE dst_15), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterOptimizeQuery.cpp:0: DB::InterpreterOptimizeQuery::execute() @ 0x00000000314d9cab in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:30.502622 [ 11867 ] {0a9c8428-e891-4afa-b925-fcbc3dfcbd68} executeQuery: Code: 60. DB::Exception: Table test_5.src_1 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37690) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO src_1 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 3), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:30.520988 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpbb97f020-1ade-4c89-86ff-87ce0f327c83' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:30.532337 [ 12137 ] {4638ebbc-63a7-4bbd-ad16-e081339a3f8b} TCPHandler: Code: 60. DB::Exception: Table test_5.dst_15 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterOptimizeQuery.cpp:0: DB::InterpreterOptimizeQuery::execute() @ 0x00000000314d9cab in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:30.636188 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.636385 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpfdd1057e-67ed-4205-9466-f2619b197ef1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:30.649649 [ 11867 ] {0a9c8428-e891-4afa-b925-fcbc3dfcbd68} TCPHandler: Code: 60. DB::Exception: Table test_5.src_1 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:30.653961 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.679711 [ 11408 ] {} ServerErrorHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 5. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 6. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::ReadBufferFromPocoSocket::ReadBufferFromPocoSocket(Poco::Net::Socket&, unsigned long) @ 0x000000001dd67083 in /usr/bin/clickhouse 7. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:0: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&) @ 0x0000000034f34955 in /usr/bin/clickhouse 8. ./build_docker/./src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x0000000034f31ceb in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.702911 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp8ce7ac2d-dad5-4754-b680-5e51114c550d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:30.719105 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb5f97f52-28a6-47c6-839f-14d0e3a7754a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:30.722219 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.725502 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.779849 [ 2194 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpe2124b13-52ae-4616-94e1-2214e6b38f27' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:30.819906 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.835337 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpaec4e9e2-6cf6-487e-a0c9-4f10e44a6c86' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:30.841158 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.915500 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe2acc92e-eead-46b7-8baa-3e2892069288' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:30.937795 [ 12137 ] {7f438595-7f0d-4b99-8faf-ab82d928946b} executeQuery: Code: 60. DB::Exception: Could not find table: dst_12. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37744) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE dst_12 DROP PARTITION 3), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:30.941716 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.945753 [ 12137 ] {7f438595-7f0d-4b99-8faf-ab82d928946b} TCPHandler: Code: 60. DB::Exception: Could not find table: dst_12. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:30.953440 [ 2058 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.953470 [ 2072 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.954325 [ 2056 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.956625 [ 2105 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.964481 [ 11886 ] {a7b63e95-8c1b-4a90-8b40-15a565e1c3f4} executeQuery: Code: 60. DB::Exception: Table test_5.src_13 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37738) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE src_13 MOVE PARTITION 0 TO TABLE dst_7), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:30.965209 [ 2102 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:30.984428 [ 11886 ] {a7b63e95-8c1b-4a90-8b40-15a565e1c3f4} TCPHandler: Code: 60. DB::Exception: Table test_5.src_13 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:30.990218 [ 11867 ] {94734999-4ccd-48b7-8a7a-160dee769a28} executeQuery: Code: 60. DB::Exception: Table test_5.dst_8 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37750) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO dst_8 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 17), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:31.008628 [ 11837 ] {88efc34f-b599-4092-8f3a-0d704f1af6f3} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57444) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO src_9 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 2), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 2024.10.22 00:34:31.014352 [ 2096 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:31.015879 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpd7f46a09-97f5-4516-adfd-b4f4816c80e0' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:31.021306 [ 11837 ] {88efc34f-b599-4092-8f3a-0d704f1af6f3} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.37 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 17. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 25. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 26. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 28. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 2024.10.22 00:34:31.022808 [ 11867 ] {94734999-4ccd-48b7-8a7a-160dee769a28} TCPHandler: Code: 60. DB::Exception: Table test_5.dst_8 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:31.066871 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:31.086701 [ 2187 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp6b7c8edd-7df9-4445-b52d-2641ec792c2f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:31.104838 [ 2187 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:31.104931 [ 11392 ] {2c4a51e7-6c5e-4e18-97db-9985411f6e47} executeQuery: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1128576 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing Numbers. (MEMORY_LIMIT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57490) (comment: 01454_storagememory_data_race_challenge.sh) (in query: INSERT INTO mem SELECT number FROM numbers(1000000);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d632bcc in /usr/bin/clickhouse 10. ./build_docker/./src/Columns/ColumnVector.h:0: DB::(anonymous namespace)::NumbersSource::generate() @ 0x000000002d237355 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:31.126418 [ 11392 ] {2c4a51e7-6c5e-4e18-97db-9985411f6e47} TCPHandler: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1128576 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.: While executing Numbers. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/Common/PODArray.h:133: DB::PODArray, 63ul, 64ul>::PODArray(unsigned long) @ 0x000000001d632bcc in /usr/bin/clickhouse 10. ./build_docker/./src/Columns/ColumnVector.h:0: DB::(anonymous namespace)::NumbersSource::generate() @ 0x000000002d237355 in /usr/bin/clickhouse 11. ./build_docker/./src/Processors/Chunk.h:90: DB::ISource::tryGenerate() @ 0x0000000034fd6c39 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/optional:344: DB::ISource::work() @ 0x0000000034fd5ec5 in /usr/bin/clickhouse 13. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 14. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000034ffd498 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000034ffcdd5 in /usr/bin/clickhouse 17. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:57: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000034ffa876 in /usr/bin/clickhouse 18. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 20. ? @ 0x00007f11b339dac3 in ? 21. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:31.188800 [ 11864 ] {0f945a9a-5580-4d98-bef0-c851f08ec2e5} executeQuery: Code: 60. DB::Exception: Table test_5.src_2 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37758) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO src_2 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:31.191873 [ 11837 ] {d82720eb-acf3-49c9-b520-f80ad85a42f8} executeQuery: Code: 60. DB::Exception: Could not find table: dst_1. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37772) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE dst_1 DROP PART ''), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:31.192005 [ 11864 ] {0f945a9a-5580-4d98-bef0-c851f08ec2e5} TCPHandler: Code: 60. DB::Exception: Table test_5.src_2 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:31.231858 [ 11837 ] {d82720eb-acf3-49c9-b520-f80ad85a42f8} TCPHandler: Code: 60. DB::Exception: Could not find table: dst_1. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:31.255934 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpbe253d23-85a1-4712-b2b3-dafd4a72045a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:31.280194 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:31.281400 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp13097480-37c4-4fbd-8700-abfdb8f5364d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:31.296007 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:31.303925 [ 2194 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp194e492f-2b81-413a-9604-a54c36fc19c4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:31.330076 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp226fb9aa-3979-41b3-83c1-c6ea4b47bcd4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:31.341119 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.41 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:31.346013 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:31.596770 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp825de255-ee2a-43d6-9722-523b163d139f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:31.608860 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:31.608994 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp550745e8-dd12-4eb9-8b93-eb85fca00a41' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:31.623782 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:31.820361 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpabbed677-a942-4ed3-8d22-9bafac934788' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:31.831708 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:31.833577 [ 12137 ] {5ec93979-e49a-46cc-b248-69822444f664} executeQuery: Code: 60. DB::Exception: Table test_5.src_14 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37858) (comment: 01154_move_partition_long.sh) (in query: OPTIMIZE TABLE src_14), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterOptimizeQuery.cpp:0: DB::InterpreterOptimizeQuery::execute() @ 0x00000000314d9cab in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:31.833791 [ 11395 ] {b26ed30d-e5b3-4caa-8f2b-3d09f3f342a6} executeQuery: Code: 60. DB::Exception: Table test_5.src_3 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37878) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO src_3 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 55), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:31.847030 [ 11886 ] {16ce16d2-de5b-4eff-ad9a-474d54c6591e} executeQuery: Code: 60. DB::Exception: Table test_5.dst_4 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37810) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO dst_4 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 26), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:31.848973 [ 12137 ] {5ec93979-e49a-46cc-b248-69822444f664} TCPHandler: Code: 60. DB::Exception: Table test_5.src_14 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterOptimizeQuery.cpp:0: DB::InterpreterOptimizeQuery::execute() @ 0x00000000314d9cab in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:31.859503 [ 11395 ] {b26ed30d-e5b3-4caa-8f2b-3d09f3f342a6} TCPHandler: Code: 60. DB::Exception: Table test_5.src_3 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:31.859676 [ 11886 ] {16ce16d2-de5b-4eff-ad9a-474d54c6591e} TCPHandler: Code: 60. DB::Exception: Table test_5.dst_4 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:31.868254 [ 11864 ] {fe502816-ea55-47a1-b5b5-929f6cada6cb} executeQuery: Code: 60. DB::Exception: Could not find table: dst_3. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37826) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE dst_3 DROP PARTITION 6), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:31.898496 [ 11864 ] {fe502816-ea55-47a1-b5b5-929f6cada6cb} TCPHandler: Code: 60. DB::Exception: Could not find table: dst_3. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:31.925623 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpf9efa91d-75d0-429d-9415-5a6a921a3247' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:31.935749 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:31.963921 [ 2104 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:31.964167 [ 2005 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:31.965198 [ 1981 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:31.965697 [ 2052 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:31.968310 [ 2014 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:31.981195 [ 2195 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp6a2f7b1e-c0cb-415c-8315-eae4cd51522c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:32.005013 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.017897 [ 2094 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.025606 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp12b34cf5-c073-4732-857d-bfc18bd915fa' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:32.026758 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp1d64d31c-3b83-421f-95a1-e02764159a04' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:32.027796 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.033710 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.045135 [ 2653 ] {8cbd8c05-6e58-4640-af4c-c97d9a9398ca} executeQuery: Code: 60. DB::Exception: Table test_5.src_13 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37896) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE src_13 MOVE PARTITION 0 TO TABLE dst_15), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.052830 [ 2653 ] {8cbd8c05-6e58-4640-af4c-c97d9a9398ca} TCPHandler: Code: 60. DB::Exception: Table test_5.src_13 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.099205 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp61afcb35-abc1-4118-aa65-062d5357930c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:32.118311 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.139815 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe8c07e23-7dac-4b7f-b5f5-3fa9a38ce696' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:32.323113 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.38 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.323221 [ 2245 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 4973314 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c62f99 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.324311 [ 11392 ] {63a7215f-8170-4909-9b30-39f63cd555f2} executeQuery: Code: 60. DB::Exception: Table test_5.src_3 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from 0.0.0.0:0) (comment: 01154_move_partition_long.sh) (in query: /* ddl_entry=query-0000000045 */ ALTER TABLE test_5.src_0 REPLACE PARTITION 0 FROM src_3), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::alterPartition(std::shared_ptr const&, std::vector> const&, std::shared_ptr) @ 0x0000000033fd4fd9 in /usr/bin/clickhouse 7. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c16c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000311292be in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.348283 [ 11864 ] {de90c87c-74b7-4bdb-9361-c6a7f87aa7e6} executeQuery: Code: 60. DB::Exception: Table test_5.src_12 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37938) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO src_12 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 9), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.361149 [ 11886 ] {50a6257f-5cf6-4013-9824-a500e9bf0504} executeQuery: Code: 60. DB::Exception: Table test_5.dst_14 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37936) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO dst_14 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 16), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.362452 [ 11864 ] {de90c87c-74b7-4bdb-9361-c6a7f87aa7e6} TCPHandler: Code: 60. DB::Exception: Table test_5.src_12 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.375828 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpdbcb36b4-4108-4864-928e-213bff85fcfd' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:32.378129 [ 11886 ] {50a6257f-5cf6-4013-9824-a500e9bf0504} TCPHandler: Code: 60. DB::Exception: Table test_5.dst_14 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.397593 [ 11392 ] {63a7215f-8170-4909-9b30-39f63cd555f2} executeQuery: Code: 60. DB::Exception: Table test_5.src_3 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37870) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE src_0 REPLACE PARTITION 0 FROM src_3), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::alterPartition(std::shared_ptr const&, std::vector> const&, std::shared_ptr) @ 0x0000000033fd4fd9 in /usr/bin/clickhouse 7. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c16c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000311292be in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.397742 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.397974 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp27a70948-dccd-450e-bf62-bd91fb61c88c' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:32.407585 [ 11392 ] {63a7215f-8170-4909-9b30-39f63cd555f2} TCPHandler: Code: 60. DB::Exception: Table test_5.src_3 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:0: DB::MergeTreeData::alterPartition(std::shared_ptr const&, std::vector> const&, std::shared_ptr) @ 0x0000000033fd4fd9 in /usr/bin/clickhouse 7. ./build_docker/./src/QueryPipeline/Pipe.h:45: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112c16c in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1322: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&, std::function) @ 0x00000000320f84a7 in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/DDLWorker.cpp:483: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002faeed30 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000002fae94e4 in /usr/bin/clickhouse 13. ./build_docker/./src/Databases/DatabaseReplicatedWorker.cpp:288: DB::DatabaseReplicatedDDLWorker::tryEnqueueAndExecuteEntry(DB::DDLLogEntry&, std::shared_ptr) @ 0x000000002f406976 in /usr/bin/clickhouse 14. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::tryEnqueueReplicatedDDL(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002f393c88 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x00000000311292be in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 19. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 20. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 24. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 25. ? @ 0x00007f11b339dac3 in ? 26. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.412973 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.510727 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp31969b52-d714-4cf3-a62d-7f822895d75b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:32.535296 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpa0973588-79b1-4a9f-bca0-15ba9842d1b3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:32.536209 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.546668 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.617600 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp02506a37-e5c3-4a07-8706-b9f23f7b5c11' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:32.621452 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp429c56ec-0f36-444c-99b9-2ee4837a78bf' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:32.623859 [ 11864 ] {d52d1541-6189-4a5b-9b19-069159e55062} executeQuery: Code: 60. DB::Exception: Table test_5.dst_1 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37976) (comment: 01154_move_partition_long.sh) (in query: OPTIMIZE TABLE dst_1), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterOptimizeQuery.cpp:0: DB::InterpreterOptimizeQuery::execute() @ 0x00000000314d9cab in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.629192 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.629225 [ 11886 ] {3a538471-7979-418f-be70-752c7f6ef158} executeQuery: Code: 60. DB::Exception: Could not find table: dst_15. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37968) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE dst_15 DROP PARTITION 4), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.631781 [ 11864 ] {d52d1541-6189-4a5b-9b19-069159e55062} TCPHandler: Code: 60. DB::Exception: Table test_5.dst_1 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterOptimizeQuery.cpp:0: DB::InterpreterOptimizeQuery::execute() @ 0x00000000314d9cab in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.631930 [ 11886 ] {3a538471-7979-418f-be70-752c7f6ef158} TCPHandler: Code: 60. DB::Exception: Could not find table: dst_15. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.648835 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.663722 [ 2241 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 4287394 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c726b9 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.866606 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp45a54022-a964-4a0d-a424-f3a90caf01b1' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:32.874088 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.925994 [ 11886 ] {0f4ddde9-31b9-4431-b878-4d77f1eaa445} executeQuery: Code: 60. DB::Exception: Table test_5.src_13 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38012) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO src_13 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 14), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.945571 [ 11864 ] {c4e01404-922f-4bec-a885-a5bca11eb014} executeQuery: Code: 60. DB::Exception: Table test_5.src_12 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38024) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE src_12 MOVE PARTITION 6 TO TABLE dst_9), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.957098 [ 2185 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpbd19dcde-990b-474a-a56b-410ab7f6f144' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:32.956420 [ 11886 ] {0f4ddde9-31b9-4431-b878-4d77f1eaa445} TCPHandler: Code: 60. DB::Exception: Table test_5.src_13 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.964551 [ 11392 ] {08253599-6733-4b71-b99d-1e46951c1854} executeQuery: Code: 60. DB::Exception: Table test_5.dst_0 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38040) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO dst_0 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 20), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.965727 [ 11864 ] {c4e01404-922f-4bec-a885-a5bca11eb014} TCPHandler: Code: 60. DB::Exception: Table test_5.src_12 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.966034 [ 2021 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.976359 [ 2051 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.976938 [ 11392 ] {08253599-6733-4b71-b99d-1e46951c1854} TCPHandler: Code: 60. DB::Exception: Table test_5.dst_0 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:32.977054 [ 2107 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.977172 [ 1979 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.977457 [ 1978 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:32.991322 [ 12137 ] {64d55fa3-f976-42f5-bc90-7686ee8dee62} executeQuery: Code: 60. DB::Exception: Could not find table: dst_10. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37996) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE dst_10 DROP PART ''), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:33.019941 [ 1997 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.035327 [ 12137 ] {64d55fa3-f976-42f5-bc90-7686ee8dee62} TCPHandler: Code: 60. DB::Exception: Could not find table: dst_10. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:33.061998 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.084154 [ 11841 ] {bcefd0c9-d22d-488d-8647-cc96622340be} executeQuery: Code: 60. DB::Exception: Table test_5.src_2 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38050) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE src_2 REPLACE PARTITION 4 FROM src_15), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:33.106837 [ 11841 ] {bcefd0c9-d22d-488d-8647-cc96622340be} TCPHandler: Code: 60. DB::Exception: Table test_5.src_2 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:33.136037 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpd438c495-33cc-417d-bc7d-dce2ab087d98' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:33.136220 [ 2196 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp4621f88b-ec51-4761-b517-a607edae261b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:33.146757 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.148820 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpee226c00-9cbe-4a74-b209-c93661b6f1b4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:33.158989 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.244354 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.283070 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp8e34696b-e911-44d7-b816-2d52c00f18c8' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:33.293006 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.342290 [ 2248 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 4270682 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c250d9 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c22b29 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d95ef79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.396204 [ 2190 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp7392e095-8137-4d44-85e0-e577688e3cfa' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:33.396379 [ 2195 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpe923ec32-294a-4683-9811-2bf990630a9a' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:33.405864 [ 2190 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.407231 [ 11864 ] {a984f197-ff1a-48d8-97f4-d2e62e970a1b} executeQuery: Code: 60. DB::Exception: Table test_5.dst_12 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38070) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO dst_12 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 20), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:33.409535 [ 2195 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.424064 [ 11864 ] {a984f197-ff1a-48d8-97f4-d2e62e970a1b} TCPHandler: Code: 60. DB::Exception: Table test_5.dst_12 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:33.446893 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp23a7de07-8762-4a6d-8b82-302f1ed09e83' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:33.447227 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp3d0b6324-1cb8-43db-bcc2-1777109a8c54' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:33.451587 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.471334 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.541794 [ 12137 ] {3db2097d-6960-4779-a2d9-1c2c5fc981d1} executeQuery: Code: 60. DB::Exception: Table test_5.src_5 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38078) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE src_5 MOVE PARTITION 5 TO TABLE dst_12), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:33.559667 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmp754af2fc-a693-49e5-ba56-99c40cd2a05e' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:33.559741 [ 12137 ] {3db2097d-6960-4779-a2d9-1c2c5fc981d1} TCPHandler: Code: 60. DB::Exception: Table test_5.src_5 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:33.589038 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.645793 [ 2196 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmp9903eed3-9171-4da5-879e-dd8739ee9ca3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:33.657461 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.661736 [ 2189 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp9b1ddd2a-23d0-455d-bac6-7b09590c4899' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:33.676338 [ 2189 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.695722 [ 2199 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpa11f0ce9-08f6-4b45-9f8e-2f212b26947b' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:33.722885 [ 2199 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.724190 [ 2194 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmpe2be18b8-a14a-4951-acea-48124222643d' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:33.724524 [ 12137 ] {44b5f356-9342-4b36-a509-a34f2ee3a5cd} executeQuery: Code: 60. DB::Exception: Table test_5.dst_6 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38088) (comment: 01154_move_partition_long.sh) (in query: OPTIMIZE TABLE dst_6), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterOptimizeQuery.cpp:0: DB::InterpreterOptimizeQuery::execute() @ 0x00000000314d9cab in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:33.725004 [ 11392 ] {8e7a42f6-afc8-4bea-99e3-1a630e6af1ae} executeQuery: Code: 60. DB::Exception: Table test_5.src_1 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38104) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE src_1 REPLACE PARTITION 2 FROM src_12), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:33.728070 [ 2194 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.729195 [ 11392 ] {8e7a42f6-afc8-4bea-99e3-1a630e6af1ae} TCPHandler: Code: 60. DB::Exception: Table test_5.src_1 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:33.729085 [ 12137 ] {44b5f356-9342-4b36-a509-a34f2ee3a5cd} TCPHandler: Code: 60. DB::Exception: Table test_5.dst_6 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterOptimizeQuery.cpp:0: DB::InterpreterOptimizeQuery::execute() @ 0x00000000314d9cab in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:33.748320 [ 11887 ] {c0fc07b9-9d6a-4b6d-a6f8-9c30ec9fbdd0} executeQuery: Code: 42. DB::Exception: Number of arguments for function L1Norm doesn't match: passed 2, should be 1: While processing L1Norm(1, 2). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57442) (comment: 02283_array_norm.sql) (in query: SELECT L1Norm(1, 2);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&, unsigned long&) @ 0x000000002827d54a in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/IFunction.cpp:398: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x000000002d8a3ae4 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a49a8 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:34:33.752757 [ 11864 ] {d010a609-b15d-4dda-a0d7-a8a59f724726} executeQuery: Code: 60. DB::Exception: Could not find table: dst_4. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38120) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE dst_4 DROP PARTITION 8), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:33.754725 [ 11887 ] {c0fc07b9-9d6a-4b6d-a6f8-9c30ec9fbdd0} TCPHandler: Code: 42. DB::Exception: Number of arguments for function L1Norm doesn't match: passed 2, should be 1: While processing L1Norm(1, 2). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&, unsigned long&) @ 0x000000002827d54a in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/IFunction.cpp:398: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x000000002d8a3ae4 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a49a8 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:34:33.796571 [ 11864 ] {d010a609-b15d-4dda-a0d7-a8a59f724726} TCPHandler: Code: 60. DB::Exception: Could not find table: dst_4. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000cd2f2db in /usr/bin/clickhouse 3. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:111: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000003112e2e9 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 7. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 8. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 13. ? @ 0x00007f11b339dac3 in ? 14. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:33.820687 [ 2211 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 4657890 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031cede59 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.891364 [ 2308 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 5160832 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__utility/swap.h:36: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000002e5e5f84 in /usr/bin/clickhouse 9. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::allocateBuffer() @ 0x000000002e5d1937 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5d00f7 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 12. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/IDataPartStorage.h:0: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341594e1 in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 20. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 21. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 23. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 27. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 28. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 29. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 30. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 31. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c44199 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.927775 [ 2197 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpfc70f423-f7db-4e2b-a1aa-c8b1bb70a3a3' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:33.949593 [ 2197 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.965004 [ 11395 ] {eedbb9b1-8441-4f31-ba39-71885c1668dc} executeQuery: Code: 60. DB::Exception: Table test_5.dst_6 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38122) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO dst_6 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 5), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:33.967697 [ 11887 ] {6b045c9f-ee02-4e59-9bce-1de1f8d4829c} executeQuery: Code: 42. DB::Exception: Number of arguments for function LpNorm doesn't match: passed 1, should be 2: While processing LpNorm([1, 2]). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57442) (comment: 02283_array_norm.sql) (in query: SELECT LpNorm([1,2]);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&, unsigned long&) @ 0x000000002827d54a in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/IFunction.cpp:398: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x000000002d8a3ae4 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a49a8 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:34:33.969272 [ 11395 ] {eedbb9b1-8441-4f31-ba39-71885c1668dc} TCPHandler: Code: 60. DB::Exception: Table test_5.dst_6 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:33.977920 [ 2029 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.979617 [ 2095 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.979985 [ 1998 ] {} test_dh4tzbjk.t2 (3789d1e0-5cce-4f52-86ee-86d106dc3811): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.980272 [ 2038 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x00000000331178a4 in /usr/bin/clickhouse 4. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:3594: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000003328b709 in /usr/bin/clickhouse 5. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 6. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007f11b339dac3 in ? 11. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:33.982866 [ 11887 ] {6b045c9f-ee02-4e59-9bce-1de1f8d4829c} TCPHandler: Code: 42. DB::Exception: Number of arguments for function LpNorm doesn't match: passed 1, should be 2: While processing LpNorm([1, 2]). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, unsigned long&, unsigned long&) @ 0x000000002827d54a in /usr/bin/clickhouse 3. ./build_docker/./src/Functions/IFunction.cpp:398: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x000000002d8a3ae4 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/vector:543: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x000000002d8a49a8 in /usr/bin/clickhouse 5. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x000000002d8a4412 in /usr/bin/clickhouse 6. ./build_docker/./src/Functions/IFunction.cpp:450: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x000000002d8a5a15 in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/ActionsDAG.cpp:0: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69cdf5 in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 15. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 19. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 23. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 26. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 27. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 29. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 31. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 2024.10.22 00:34:33.983004 [ 2078 ] {} test_dh4tzbjk.t3 (16ebfbcd-009f-429e-87f2-554b587d4f99): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r3). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:34.024266 [ 2097 ] {} test_dh4tzbjk.t1 (76c55061-a644-41a9-9502-5dd9a722b3ad): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /parallel_replicas/test_dh4tzbjk/test_tbl/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000cd3095b in /usr/bin/clickhouse 3. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:5273: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000003327aac9 in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 5. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007f11b339dac3 in ? 10. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:34.027681 [ 2184 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1} TemporaryFileOnDisk: Temporary path 'tmp27ee7efa-7292-48f9-b457-c551b64a32a5' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:34.050758 [ 2184 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_15_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:34.137239 [ 2186 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpfeb14206-f1ef-48ec-9fd6-7657d8c6c31f' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:34.149052 [ 2186 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.42 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:34.149515 [ 2198 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp9477bc06-bb36-49ae-96f6-0185e53174b4' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:34.166009 [ 2198 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.39 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:34.170376 [ 2185 ] {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1} TemporaryFileOnDisk: Temporary path 'tmpf4f8c2a3-5f67-4d6c-a758-006d310585a6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:34.220013 [ 2196 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} TemporaryFileOnDisk: Temporary path 'tmpb0798038-ad92-48f3-8d1b-295517c7bcb6' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:34.220823 [ 2193 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1} TemporaryFileOnDisk: Temporary path 'tmp427b4c51-2915-47b3-a67c-8dc9581f8ac9' does not exist in '/var/lib/clickhouse/tmp/' 2024.10.22 00:34:34.474176 [ 2185 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {84f788e2-4f4e-45fa-bf6b-97219cb78fa2::201403_1_8_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:34.474558 [ 2242 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.43 GiB (attempt to allocate chunk of 5218717 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031c53899 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031c51386 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d961c79 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:34.475450 [ 2192 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {17028bf5-9256-4ee8-a9c7-fd9ae02e15e8::202410_1_65_13}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1086271 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromS3.cpp:103: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x000000002e5ced09 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr const&, std::shared_ptr const&, String&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000002f51a55f in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:247: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002f5081ac in /usr/bin/clickhouse 14. ./build_docker/./src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:0: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000002ddce07e in /usr/bin/clickhouse 15. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:0: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000002f57b467 in /usr/bin/clickhouse 16. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:0: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000002f530d2d in /usr/bin/clickhouse 17. ./build_docker/./src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:132: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x0000000033ccad28 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:196: DB::MergeTreeDataPartWriterOnDisk::initPrimaryIndex() @ 0x00000000341799a3 in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:128: DB::MergeTreeDataPartWriterOnDisk::MergeTreeDataPartWriterOnDisk(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341791d5 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:28: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000341592e6 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 22. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergedBlockOutputStream* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>, std::shared_ptr&, std::shared_ptr&, bool, bool&, DB::WriteSettings, DB::MergedBlockOutputStream*>(DB::MergedBlockOutputStream*, std::shared_ptr&, std::shared_ptr&, DB::NamesAndTypesList&, std::vector, std::allocator>>&&, std::shared_ptr&, std::shared_ptr&, bool&&, bool&, DB::WriteSettings&&) @ 0x0000000033eb2761 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e927c2 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 26. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 27. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 28. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 29. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 30. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:34.475540 [ 2309 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 5168695 bytes), maximum: 15.30 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 7. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 8. ./build_docker/./src/IO/BufferWithOwnMemory.h:80: DB::CompressedWriteBuffer::CompressedWriteBuffer(DB::WriteBuffer&, std::shared_ptr, unsigned long) @ 0x000000002ec7be33 in /usr/bin/clickhouse 9. ./build_docker/./src/Storages/MergeTree/MergeTreeDataPartWriterCompact.h:75: std::shared_ptr std::allocate_shared[abi:v15000], DB::HashingWriteBuffer&, std::shared_ptr&, void>(std::allocator const&, DB::HashingWriteBuffer&, std::shared_ptr&) @ 0x0000000034167a94 in /usr/bin/clickhouse 10. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: void std::__function::__policy_invoker::__call_impl const&)::$_0, void (DB::ISerialization::SubstreamPath const&)>>(std::__function::__policy_storage const*, DB::ISerialization::SubstreamPath const&) @ 0x0000000034162cd3 in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:1613: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x000000002f140658 in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x000000002f140e1a in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:100: DB::MergeTreeDataPartWriterCompact::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&) @ 0x000000003415b155 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeDataPartWriterCompact::MergeTreeDataPartWriterCompact(std::shared_ptr const&, DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, String const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003415a301 in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getWriter(DB::NamesAndTypesList const&, std::shared_ptr const&, std::vector, std::allocator>> const&, std::shared_ptr const&, DB::MergeTreeWriterSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x000000003412cf5c in /usr/bin/clickhouse 16. ./build_docker/./src/Storages/MergeTree/MergedBlockOutputStream.cpp:51: DB::MergedBlockOutputStream::MergedBlockOutputStream(std::shared_ptr const&, std::shared_ptr const&, DB::NamesAndTypesList const&, std::vector, std::allocator>> const&, std::shared_ptr, std::shared_ptr const&, bool, bool, DB::WriteSettings const&, DB::MergeTreeIndexGranularity const&) @ 0x00000000345c176b in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr, bool, bool, DB::WriteSettings>(std::shared_ptr&, std::shared_ptr const&, DB::NamesAndTypesList&, std::vector, std::allocator>>&, std::shared_ptr&, std::shared_ptr&&, bool&&, bool&&, DB::WriteSettings&&) @ 0x00000000345b8476 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:567: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x00000000345ab92f in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergeTreeDataWriter.cpp:385: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x00000000345a5f1b in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000003498e141 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000035a064af in /usr/bin/clickhouse 22. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000357c18cc in /usr/bin/clickhouse 23. ./build_docker/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:102: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x00000000357c13c8 in /usr/bin/clickhouse 24. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:818: DB::ExceptionKeepingTransform::work() @ 0x00000000357bfff7 in /usr/bin/clickhouse 25. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x000000003501c58e in /usr/bin/clickhouse 26. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000034ffee3c in /usr/bin/clickhouse 27. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:149: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000034ffdcbc in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/SystemLog.cpp:509: DB::SystemLog::flushImpl(std::vector> const&, unsigned long) @ 0x0000000031ccf059 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/SystemLog.cpp:0: DB::SystemLog::savingThreadFunction() @ 0x0000000031cccb46 in /usr/bin/clickhouse 30. ./build_docker/./src/Common/ThreadPool.h:243: decltype(std::declval::startup()::'lambda'()>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl::startup()::'lambda'()>(DB::SystemLogBase::startup()::'lambda'()&&)::'lambda'()&>(DB::SystemLogBase::startup()::'lambda'()&&) @ 0x000000001d9693f9 in /usr/bin/clickhouse 31. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:34.476034 [ 2196 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:34.476204 [ 2193 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_8_16_1}: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 15.40 GiB (attempt to allocate chunk of 1048639 bytes), maximum: 15.30 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or overcommit denominator are set to zero. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x000000001d611bf1 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60f2b9 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000001d60ec74 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/CurrentMemoryTracker.cpp:59: CurrentMemoryTracker::alloc(long) @ 0x000000001d53c01d in /usr/bin/clickhouse 8. ./build_docker/./src/Common/Allocator.h:102: Allocator::alloc(unsigned long, unsigned long) @ 0x000000001d5306ef in /usr/bin/clickhouse 9. ./build_docker/./src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001d702820 in /usr/bin/clickhouse 10. ./build_docker/./src/IO/BufferWithOwnMemory.h:0: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001d761a20 in /usr/bin/clickhouse 11. ./build_docker/./src/IO/WriteBufferFromFileDescriptor.cpp:102: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr, unsigned long, String) @ 0x000000001d75f185 in /usr/bin/clickhouse 12. ./build_docker/./src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr, unsigned int, char*, unsigned long) @ 0x000000001d9887a0 in /usr/bin/clickhouse 13. ./build_docker/./src/Disks/IO/WriteBufferFromTemporaryFile.cpp:17: DB::WriteBufferFromTemporaryFile::WriteBufferFromTemporaryFile(std::unique_ptr>&&) @ 0x000000002f496fe5 in /usr/bin/clickhouse 14. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: DB::TemporaryDataOnDisk::createRawStream(unsigned long) @ 0x0000000031e47c9c in /usr/bin/clickhouse 15. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000033e90037 in /usr/bin/clickhouse 16. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: bool std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000033eba63c in /usr/bin/clickhouse 17. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000033e9efb9 in /usr/bin/clickhouse 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000033eab05a in /usr/bin/clickhouse 19. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000034992b47 in /usr/bin/clickhouse 20. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:284: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000033ee7d16 in /usr/bin/clickhouse 21. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000033ee9cf9 in /usr/bin/clickhouse 22. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x000000001d8b0c1c in /usr/bin/clickhouse 23. ./build_docker/./src/Common/ThreadPool.h:243: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x000000001d8bb080 in /usr/bin/clickhouse 24. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 25. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 26. ? @ 0x00007f11b339dac3 in ? 27. ? @ 0x00007f11b342f850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:34:34.477193 [ 11395 ] {ce193407-6d61-467f-a255-8e4d38f29f2e} executeQuery: Code: 60. DB::Exception: Table test_5.src_14 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38172) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE src_14 MOVE PARTITION 0 TO TABLE dst_12), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:34.477254 [ 11887 ] {90f63324-155f-46b9-9656-1ab7a95fb358} executeQuery: Code: 69. DB::Exception: Second argument for function arrayLpNorm must be not less than one and not be an infinity: While processing LpNorm([1, 2], -3.4). (ARGUMENT_OUT_OF_BOUND) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57442) (comment: 02283_array_norm.sql) (in query: SELECT LpNorm([1,2], -3.4);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::FunctionArrayNorm::initConstParams(std::vector> const&) const @ 0x000000001c9c2d73 in /usr/bin/clickhouse 4. COW::immutable_ptr DB::FunctionArrayNorm::executeWithTypes(DB::ColumnArray const&, unsigned long, std::vector> const&) const @ 0x000000001c9eadae in /usr/bin/clickhouse 5. COW::immutable_ptr DB::FunctionArrayNorm::executeWithResultType(DB::ColumnArray const&, std::shared_ptr const&, unsigned long, std::vector> const&) const @ 0x000000001c9e5972 in /usr/bin/clickhouse 6. DB::FunctionArrayNorm::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001c9e3aca in /usr/bin/clickhouse 7. DB::TupleOrArrayFunction::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001af91d61 in /usr/bin/clickhouse 8. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:34:34.477855 [ 11864 ] {d4951467-25c1-46be-b780-a92e14dca2c4} executeQuery: Code: 60. DB::Exception: Table test_5.src_14 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38160) (comment: 01154_move_partition_long.sh) (in query: ALTER TABLE src_14 REPLACE PARTITION 8 FROM src_10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:34.488455 [ 2653 ] {675a255d-5604-4975-82d9-f6a57582541d} executeQuery: Code: 60. DB::Exception: Table test_5.dst_9 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38196) (comment: 01154_move_partition_long.sh) (in query: INSERT INTO dst_9 SELECT * FROM generateRandom('p UInt64, k UInt64, v UInt64') LIMIT 91), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:34.487823 [ 11841 ] {a73182f3-1668-456f-a5b3-9ec5d92f322c} executeQuery: Code: 60. DB::Exception: Table test_5.dst_2 does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:38182) (comment: 01154_move_partition_long.sh) (in query: OPTIMIZE TABLE dst_2), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterOptimizeQuery.cpp:0: DB::InterpreterOptimizeQuery::execute() @ 0x00000000314d9cab in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:34.583464 [ 11395 ] {ce193407-6d61-467f-a255-8e4d38f29f2e} TCPHandler: Code: 60. DB::Exception: Table test_5.src_14 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:34.589338 [ 11864 ] {d4951467-25c1-46be-b780-a92e14dca2c4} TCPHandler: Code: 60. DB::Exception: Table test_5.src_14 does not exist. Maybe you meant src_0?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000be09a1b in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:29: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42eeb5 in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Databases/DatabaseReplicated.cpp:0: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const::$_0::operator()(std::shared_ptr const&) const @ 0x000000002f3d09f6 in /usr/bin/clickhouse 7. ./build_docker/./src/Databases/DatabaseReplicated.cpp:1503: DB::DatabaseReplicated::shouldReplicateQuery(std::shared_ptr const&, std::shared_ptr const&) const @ 0x000000002f3d00d4 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x0000000031129100 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterAlterQuery.cpp:69: DB::InterpreterAlterQuery::execute() @ 0x0000000031126955 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 11. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 12. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 13. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 15. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 16. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 18. ? @ 0x00007f11b339dac3 in ? 19. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:34.596039 [ 2653 ] {675a255d-5604-4975-82d9-f6a57582541d} TCPHandler: Code: 60. DB::Exception: Table test_5.dst_9 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x00000000314a227d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:0: DB::InterpreterInsertQuery::execute() @ 0x00000000314ab2ea in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 11. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 15. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 16. ? @ 0x00007f11b339dac3 in ? 17. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:34:34.596987 [ 11887 ] {90f63324-155f-46b9-9656-1ab7a95fb358} TCPHandler: Code: 69. DB::Exception: Second argument for function arrayLpNorm must be not less than one and not be an infinity: While processing LpNorm([1, 2], -3.4). (ARGUMENT_OUT_OF_BOUND), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000bd8589b in /usr/bin/clickhouse 3. DB::FunctionArrayNorm::initConstParams(std::vector> const&) const @ 0x000000001c9c2d73 in /usr/bin/clickhouse 4. COW::immutable_ptr DB::FunctionArrayNorm::executeWithTypes(DB::ColumnArray const&, unsigned long, std::vector> const&) const @ 0x000000001c9eadae in /usr/bin/clickhouse 5. COW::immutable_ptr DB::FunctionArrayNorm::executeWithResultType(DB::ColumnArray const&, std::shared_ptr const&, unsigned long, std::vector> const&) const @ 0x000000001c9e5972 in /usr/bin/clickhouse 6. DB::FunctionArrayNorm::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001c9e3aca in /usr/bin/clickhouse 7. DB::TupleOrArrayFunction::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001af91d61 in /usr/bin/clickhouse 8. DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd879f5 in /usr/bin/clickhouse 9. DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000bd8730c in /usr/bin/clickhouse 10. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c8e9 in /usr/bin/clickhouse 11. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:202: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89ba5f in /usr/bin/clickhouse 12. ./build_docker/./src/Functions/IFunction.cpp:0: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89c81b in /usr/bin/clickhouse 13. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d89e823 in /usr/bin/clickhouse 14. ./build_docker/./src/Functions/IFunction.cpp:379: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000002d8a2f1f in /usr/bin/clickhouse 15. ./build_docker/./contrib/boost/boost/smart_ptr/intrusive_ptr.hpp:117: DB::ActionsDAG::addFunctionImpl(std::shared_ptr const&, std::vector>, std::vector>, String, std::shared_ptr, bool) @ 0x000000002f69eb71 in /usr/bin/clickhouse 16. ./build_docker/./src/Interpreters/ActionsDAG.cpp:199: DB::ActionsDAG::addFunction(std::shared_ptr const&, std::vector>, String) @ 0x000000002f69d066 in /usr/bin/clickhouse 17. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:0: DB::ScopeStack::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd1cc7d in /usr/bin/clickhouse 18. ./build_docker/./src/Interpreters/ActionsVisitor.h:0: DB::ActionsMatcher::Data::addFunction(std::shared_ptr const&, std::vector> const&, String) @ 0x000000002fd46ce0 in /usr/bin/clickhouse 19. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::ActionsMatcher::visit(DB::ASTFunction const&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd22a0b in /usr/bin/clickhouse 20. ./build_docker/./src/Interpreters/ActionsVisitor.cpp:789: DB::ActionsMatcher::visit(DB::ASTExpressionList&, std::shared_ptr const&, DB::ActionsMatcher::Data&) @ 0x000000002fd39bf5 in /usr/bin/clickhouse 21. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:78: DB::InDepthNodeVisitor const>::doVisit(std::shared_ptr const&) @ 0x000000002fd0427c in /usr/bin/clickhouse 22. ./build_docker/./src/Interpreters/InDepthNodeVisitor.h:64: DB::ExpressionAnalyzer::getRootActions(std::shared_ptr const&, bool, std::shared_ptr&, bool) @ 0x000000002fca8f15 in /usr/bin/clickhouse 23. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::SelectQueryExpressionAnalyzer::appendSelect(DB::ExpressionActionsChain&, bool) @ 0x000000002fcc9d6a in /usr/bin/clickhouse 24. ./build_docker/./src/Interpreters/ExpressionAnalyzer.cpp:0: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000002fcd82d6 in /usr/bin/clickhouse 25. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:946: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000003152e1b1 in /usr/bin/clickhouse 26. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:769: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000003151aff3 in /usr/bin/clickhouse 27. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150a011 in /usr/bin/clickhouse 28. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 29. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 30. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 31. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 2024.10.22 00:34:34.599499 [ 2404 ] {691a4750-ea09-4df2-a30d-ac44f6eeb578} : Logical error: 'inserted'. 2024.10.22 00:34:34.599962 [ 2401 ] {691a4750-ea09-4df2-a30d-ac44f6eeb578} : Logical error: 'inserted'. 2024.10.22 00:34:34.607616 [ 11841 ] {a73182f3-1668-456f-a5b3-9ec5d92f322c} TCPHandler: Code: 60. DB::Exception: Table test_5.dst_2 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/InterpreterOptimizeQuery.cpp:0: DB::InterpreterOptimizeQuery::execute() @ 0x00000000314d9cab in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eecdd in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 9. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 10. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 12. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 14. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 15. ? @ 0x00007f11b339dac3 in ? 16. ? @ 0x00007f11b342f850 in ? 2024.10.22 00:43:15.625601 [ 1906 ] {} Application: Child process was terminated by signal 6. 2024.10.22 00:58:16.919069 [ 40418 ] {} Context: Server was built with sanitizer. It will work slowly. 2024.10.22 00:58:16.919245 [ 40418 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2024.10.22 00:58:16.920434 [ 40418 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.10.22 00:58:17.516162 [ 40418 ] {} Context: The setting 'merge_tree_metadata_cache' is enabled. But the feature of 'metadata cache in RocksDB' is experimental and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. See the corresponding report at https://github.com/ClickHouse/ClickHouse/issues/51182 2024.10.22 00:58:17.911477 [ 40418 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.10.22 00:58:17.918270 [ 40418 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.10.22 00:58:17.918303 [ 40418 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.10.22 00:58:17.969079 [ 40643 ] {} RaftInstance: Election timeout, initiate leader election 2024.10.22 00:58:19.060725 [ 40418 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.10.22 00:58:20.017994 [ 40418 ] {} DatabaseReplicated (test_91kxgswp): Database test_91kxgswp exists locally, but its replica does not exist in ZooKeeper (/test/db/test_2/replicas/s1|r1). Assuming it was dropped, will not try to start it up 2024.10.22 00:58:20.037360 [ 40418 ] {} TablesLoader: Tables test_7.dist_01683 depend on default.n, but seems like that does not exist. Will ignore it and try to load existing tables 2024.10.22 00:58:21.478281 [ 40790 ] {} test_5.src_9 (559aa2c3-4958-484b-a354-cb9531a68a7a): Removing temporary directory /var/lib/clickhouse/disks/s3/store/559/559aa2c3-4958-484b-a354-cb9531a68a7a/tmp_insert_9_2_2_0/ 2024.10.22 00:58:21.478326 [ 40790 ] {} test_5.src_9 (559aa2c3-4958-484b-a354-cb9531a68a7a): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/559/559aa2c3-4958-484b-a354-cb9531a68a7a/tmp_insert_9_2_2_0/ 2024.10.22 00:58:21.479499 [ 40790 ] {} test_5.src_9 (559aa2c3-4958-484b-a354-cb9531a68a7a): Removing temporary directory /var/lib/clickhouse/disks/s3/store/559/559aa2c3-4958-484b-a354-cb9531a68a7a/tmp_insert_2_3_3_0/ 2024.10.22 00:58:21.479542 [ 40790 ] {} test_5.src_9 (559aa2c3-4958-484b-a354-cb9531a68a7a): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/559/559aa2c3-4958-484b-a354-cb9531a68a7a/tmp_insert_2_3_3_0/ 2024.10.22 00:59:24.657626 [ 40424 ] {917c0098-1c49-4b78-9a37-ff509d19e1f9} executeQuery: Code: 60. DB::Exception: Table test_15.dst does not exist. (UNKNOWN_TABLE) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46578) (comment: 01071_window_view_event_tumble_asc_join.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007ff65ddaeac3 in ? 22. ? @ 0x00007ff65de40850 in ? 2024.10.22 00:59:24.680545 [ 40776 ] {} ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, unsigned long&, String&&) @ 0x000000000c5edab7 in /usr/bin/clickhouse 3. DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x000000000c5ed651 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/TransformEndianness.hpp:18: Coordination::ZooKeeper::receiveEvent() @ 0x0000000036452b89 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::receiveThread() @ 0x00000000364518b7 in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036463582 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007ff65ddaeac3 in ? 10. ? @ 0x00007ff65de40850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:59:24.693315 [ 40787 ] {} ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:44254 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000001dd6c55b in /usr/bin/clickhouse 3. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000001dd6a911 in /usr/bin/clickhouse 4. ./build_docker/./src/IO/WriteBuffer.h:60: Coordination::ZooKeeperRequest::write(DB::WriteBuffer&) const @ 0x00000000363fab6b in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:0: Coordination::ZooKeeper::sendThread() @ 0x000000003644ef7d in /usr/bin/clickhouse 6. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036463022 in /usr/bin/clickhouse 7. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 8. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 9. ? @ 0x00007ff65ddaeac3 in ? 10. ? @ 0x00007ff65de40850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:59:24.693903 [ 40473 ] {} test_dh4tzbjk.t1 (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.10.22 00:59:24.694057 [ 40472 ] {} test_dh4tzbjk.t2 (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.10.22 00:59:24.694458 [ 40476 ] {} test_dh4tzbjk.t3 (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.10.22 00:59:24.721619 [ 40776 ] {} ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x000000003e08e96e in /usr/bin/clickhouse 2. ./build_docker/./base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x000000003dc7fe2e in /usr/bin/clickhouse 3. ./build_docker/./base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::error(int, String const&) @ 0x000000003dc9c71c in /usr/bin/clickhouse 4. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Poco::Net::SocketImpl::shutdown() @ 0x000000003dca241d in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:969: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000003643c54f in /usr/bin/clickhouse 6. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: Coordination::ZooKeeper::receiveThread() @ 0x0000000036452540 in /usr/bin/clickhouse 7. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000036463582 in /usr/bin/clickhouse 8. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 10. ? @ 0x00007ff65ddaeac3 in ? 11. ? @ 0x00007ff65de40850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:59:24.773262 [ 40591 ] {} test_dh4tzbjk.t1 (ReplicatedMergeTreeCleanupThread): void DB::ReplicatedMergeTreeCleanupThread::run(): Code: 999. Coordination::Exception: Coordination error: Session expired, path /parallel_replicas/test_dh4tzbjk/test_tbl/log. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:199: DB::ReplicatedMergeTreeCleanupThread::clearOldLogs() @ 0x0000000034703f8c in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:0: DB::ReplicatedMergeTreeCleanupThread::iterate() @ 0x0000000034701b67 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:0: DB::ReplicatedMergeTreeCleanupThread::run() @ 0x00000000346ffb30 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 10. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 11. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 14. ? @ 0x00007ff65ddaeac3 in ? 15. ? @ 0x00007ff65de40850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:59:24.818680 [ 40467 ] {} test_dh4tzbjk.t2 (ReplicatedMergeTreeCleanupThread): void DB::ReplicatedMergeTreeCleanupThread::run(): Code: 999. Coordination::Exception: Coordination error: Session expired, path /parallel_replicas/test_dh4tzbjk/test_tbl/log. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:199: DB::ReplicatedMergeTreeCleanupThread::clearOldLogs() @ 0x0000000034703f8c in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:0: DB::ReplicatedMergeTreeCleanupThread::iterate() @ 0x0000000034701b67 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:0: DB::ReplicatedMergeTreeCleanupThread::run() @ 0x00000000346ffb30 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 10. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 11. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 14. ? @ 0x00007ff65ddaeac3 in ? 15. ? @ 0x00007ff65de40850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:59:24.818475 [ 40593 ] {} test_dh4tzbjk.t3 (ReplicatedMergeTreeCleanupThread): void DB::ReplicatedMergeTreeCleanupThread::run(): Code: 999. Coordination::Exception: Coordination error: Connection loss, path /parallel_replicas/test_dh4tzbjk/test_tbl/log. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. ./build_docker/./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x000000002d723d77 in /usr/bin/clickhouse 3. ./build_docker/./src/Common/ZooKeeper/IKeeper.h:482: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x000000002d7221b0 in /usr/bin/clickhouse 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:475: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000003636d003 in /usr/bin/clickhouse 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:467: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000003636cb0f in /usr/bin/clickhouse 6. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:199: DB::ReplicatedMergeTreeCleanupThread::clearOldLogs() @ 0x0000000034703f8c in /usr/bin/clickhouse 7. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:0: DB::ReplicatedMergeTreeCleanupThread::iterate() @ 0x0000000034701b67 in /usr/bin/clickhouse 8. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp:0: DB::ReplicatedMergeTreeCleanupThread::run() @ 0x00000000346ffb30 in /usr/bin/clickhouse 9. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:0: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002e685dd8 in /usr/bin/clickhouse 10. ./build_docker/./src/Core/BackgroundSchedulePool.cpp:0: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002e68d284 in /usr/bin/clickhouse 11. ./build_docker/./src/Common/ThreadPool.h:243: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002e68e822 in /usr/bin/clickhouse 12. ./build_docker/./base/base/../base/wide_integer_impl.h:809: ThreadPoolImpl::worker(std::__list_iterator) @ 0x000000001d8a7712 in /usr/bin/clickhouse 13. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000001d8b59ed in /usr/bin/clickhouse 14. ? @ 0x00007ff65ddaeac3 in ? 15. ? @ 0x00007ff65de40850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:59:24.817745 [ 40424 ] {917c0098-1c49-4b78-9a37-ff509d19e1f9} TCPHandler: Code: 60. DB::Exception: Table test_15.dst does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(String const&, int) @ 0x000000003e082673 in /usr/bin/clickhouse 1. ./build_docker/./src/Common/Exception.cpp:98: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001d5cce50 in /usr/bin/clickhouse 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000bd89e96 in /usr/bin/clickhouse 3. ./build_docker/./src/Databases/IDatabase.cpp:27: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000002f42ed2b in /usr/bin/clickhouse 4. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:0: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000002fb275ac in /usr/bin/clickhouse 5. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:927: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000002fb396e2 in /usr/bin/clickhouse 6. ./build_docker/./src/Interpreters/JoinedTables.cpp:0: DB::JoinedTables::getLeftTableStorage() @ 0x000000003179c85d in /usr/bin/clickhouse 7. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:0: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000003150565b in /usr/bin/clickhouse 8. ./build_docker/./src/Interpreters/InterpreterSelectQuery.cpp:206: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000031502217 in /usr/bin/clickhouse 9. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:257: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x00000000316e1ab8 in /usr/bin/clickhouse 10. ./build_docker/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:0: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000316dd9ba in /usr/bin/clickhouse 11. ./build_docker/./contrib/llvm-project/libcxx/include/vector:580: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions const&) @ 0x000000003144e834 in /usr/bin/clickhouse 12. ./build_docker/./src/Interpreters/InterpreterFactory.cpp:0: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000003144ba8f in /usr/bin/clickhouse 13. ./build_docker/./src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000320eda3b in /usr/bin/clickhouse 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000320e5aa1 in /usr/bin/clickhouse 15. ./build_docker/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x0000000034ed6d3d in /usr/bin/clickhouse 16. ./build_docker/./src/Server/TCPHandler.cpp:2161: DB::TCPHandler::run() @ 0x0000000034f13b30 in /usr/bin/clickhouse 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x000000003dcb69cf in /usr/bin/clickhouse 18. ./build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: Poco::Net::TCPServerDispatcher::run() @ 0x000000003dcb7797 in /usr/bin/clickhouse 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:0: Poco::PooledThread::run() @ 0x000000003e196fbc in /usr/bin/clickhouse 20. ./build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:0: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003e190068 in /usr/bin/clickhouse 21. ? @ 0x00007ff65ddaeac3 in ? 22. ? @ 0x00007ff65de40850 in ? 2024.10.22 00:59:26.628631 [ 40418 ] {} Application: Closed all listening sockets. Waiting for 1 outstanding connections. 2024.10.22 00:59:27.564906 [ 40687 ] {} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/xce/ovcprjvlbfougtecsvjglxgbpzjhd, total size 53111135, count 53111135, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 68fad9b6-f8f9-49dd-af74-5eece860ae49, upload has finished false. 2024.10.22 00:59:27.564944 [ 40687 ] {} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/xce/ovcprjvlbfougtecsvjglxgbpzjhd, total size 53111135, count 53111135, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 68fad9b6-f8f9-49dd-af74-5eece860ae49, upload has finished false 2024.10.22 00:59:27.577981 [ 40687 ] {} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/xce/ovcprjvlbfougtecsvjglxgbpzjhd, total size 53111135, count 53111135, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 68fad9b6-f8f9-49dd-af74-5eece860ae49, upload has finished false 2024.10.22 00:59:27.590479 [ 40674 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/kxl/jjudihdsyezxtjzekobnreyaahpdr, total size 46381564, count 46381564, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id c23235d0-76a9-40b5-a3ad-bab71ed5127c, upload has finished false. 2024.10.22 00:59:27.590509 [ 40674 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/kxl/jjudihdsyezxtjzekobnreyaahpdr, total size 46381564, count 46381564, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id c23235d0-76a9-40b5-a3ad-bab71ed5127c, upload has finished false 2024.10.22 00:59:27.605307 [ 40674 ] {7a54e4e2-5cab-4fd8-8132-8a58bd71d1ef::201403_17_24_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/kxl/jjudihdsyezxtjzekobnreyaahpdr, total size 46381564, count 46381564, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id c23235d0-76a9-40b5-a3ad-bab71ed5127c, upload has finished false 2024.10.22 00:59:27.703372 [ 40686 ] {} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key common/bak/kfjtyzqltbrgppdvtedpexyzdkoid, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 3bd80ff3-5d5e-4566-971d-13a2a4727756, upload has finished false. 2024.10.22 00:59:27.703448 [ 40686 ] {} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key common/bak/kfjtyzqltbrgppdvtedpexyzdkoid, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 3bd80ff3-5d5e-4566-971d-13a2a4727756, upload has finished false 2024.10.22 00:59:27.717606 [ 40686 ] {} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key common/bak/kfjtyzqltbrgppdvtedpexyzdkoid, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 3bd80ff3-5d5e-4566-971d-13a2a4727756, upload has finished false 2024.10.22 00:59:28.631005 [ 40644 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2024.10.22 00:59:28.641548 [ 40639 ] {} KeeperLogStore: Raft server is not set in LogStore. 2024.10.22 00:59:28.650421 [ 40418 ] {} KeeperLogStore: Changelog is shut down